-- Logs begin at Fri 2022-09-30 18:29:39 UTC, end at Fri 2022-09-30 19:43:53 UTC. -- Sep 30 19:13:47.975829 dv-cinder-860015-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 30 19:13:47.983165 dv-cinder-860015-1-smb devstack@keystone.service[81446]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 30 19:13:47.985190 dv-cinder-860015-1-smb devstack@keystone.service[81446]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 30 19:13:47 2022] *** Sep 30 19:13:47.985190 dv-cinder-860015-1-smb devstack@keystone.service[81446]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 30 19:13:47.985190 dv-cinder-860015-1-smb devstack@keystone.service[81446]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 30 19:13:47.985190 dv-cinder-860015-1-smb devstack@keystone.service[81446]: nodename: dv-cinder-860015-1-smb Sep 30 19:13:47.985190 dv-cinder-860015-1-smb devstack@keystone.service[81446]: machine: x86_64 Sep 30 19:13:47.985190 dv-cinder-860015-1-smb devstack@keystone.service[81446]: clock source: unix Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: pcre jit disabled Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: detected number of CPU cores: 4 Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: current working directory: / Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: detected binary path: /usr/bin/uwsgi-core Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: your processes number limit is 47680 Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: your memory page size is 4096 bytes Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: detected max file descriptor number: 2048 Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: lock engine: pthread robust mutexes Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: thunder lock: enabled Sep 30 19:13:47.985595 dv-cinder-860015-1-smb devstack@keystone.service[81446]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 30 19:13:47.989807 dv-cinder-860015-1-smb devstack@keystone.service[81446]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 30 19:13:48.026944 dv-cinder-860015-1-smb devstack@keystone.service[81446]: Python main interpreter initialized at 0x5649b8af19c0 Sep 30 19:13:48.026944 dv-cinder-860015-1-smb devstack@keystone.service[81446]: python threads support enabled Sep 30 19:13:48.026944 dv-cinder-860015-1-smb devstack@keystone.service[81446]: your server socket listen backlog is limited to 100 connections Sep 30 19:13:48.026944 dv-cinder-860015-1-smb devstack@keystone.service[81446]: your mercy for graceful operations on workers is 90 seconds Sep 30 19:13:48.027319 dv-cinder-860015-1-smb devstack@keystone.service[81446]: mapped 403077 bytes (393 KB) for 2 cores Sep 30 19:13:48.027411 dv-cinder-860015-1-smb devstack@keystone.service[81446]: *** Operational MODE: preforking *** Sep 30 19:13:48.027661 dv-cinder-860015-1-smb devstack@keystone.service[81446]: *** uWSGI is running in multiple interpreter mode *** Sep 30 19:13:48.027661 dv-cinder-860015-1-smb devstack@keystone.service[81446]: spawned uWSGI master process (pid: 81446) Sep 30 19:13:48.027863 dv-cinder-860015-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 30 19:13:48.028958 dv-cinder-860015-1-smb devstack@keystone.service[81446]: spawned uWSGI worker 1 (pid: 81454, cores: 1) Sep 30 19:13:48.028958 dv-cinder-860015-1-smb devstack@keystone.service[81446]: spawned uWSGI worker 2 (pid: 81455, cores: 1) Sep 30 19:13:48.028958 dv-cinder-860015-1-smb devstack@keystone.service[81446]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 30 19:13:52.344065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:13:52.344065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: from cryptography.utils import int_from_bytes Sep 30 19:13:52.344864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:13:52.344864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: from cryptography.utils import int_from_bytes Sep 30 19:13:52.346648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:13:52.346648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: from cryptography.utils import int_from_bytes Sep 30 19:13:52.347115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 30 19:13:52.347115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: from cryptography.utils import int_from_bytes Sep 30 19:13:52.395025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 19:13:52.395215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 19:13:52.395407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] command line args: [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 19:13:52.395674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 19:13:52.395847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ================================================================================ {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 19:13:52.396096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] admin_token = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.396336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] config_dir = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.396520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.396700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] config_source = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.396877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] debug = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.397070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.397565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.397660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 30 19:13:52.397725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.397790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 30 19:13:52.397854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.397972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] command line args: [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 30 19:13:52.398114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.398233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 30 19:13:52.398337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] list_limit = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.398437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ================================================================================ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 30 19:13:52.398540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] log_config_append = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.398642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] admin_token = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.398749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.398852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] log_dir = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.398946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config_dir = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] log_file = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config_source = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] debug = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.399896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400757 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_config_append = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.400963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_dir = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.401860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.402962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] publish_errors = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.403887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] standard_threads = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.404895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] use_journal = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] use_json = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] use_stderr = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] publish_errors = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] use_syslog = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.405875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.406036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.406133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.406307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.406458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.406540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.406616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.406770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] standard_threads = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.406854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.407006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.407103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.407340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.407417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.407553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.407630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.407733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_journal = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.407821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.407894 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_json = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.408053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.408131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_stderr = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.408235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_syslog = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.408317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.408473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 30 19:13:52.408552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.408733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.408810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.408976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.409938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.410950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.411936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.412923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.413866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.414877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.415944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.416965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.417880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.418970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419754 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.419979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.420917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.421845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.422857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.423841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.424952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.425990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.426964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.427921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.428857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.429927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.430986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] auth.external = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.431920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] auth.password = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] auth.token = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.432878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.433985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.external = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] credential.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.434966 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.password = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.token = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.435932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.436973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.437953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.438146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.438239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.438931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439648 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.439973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.440939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.441897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.442882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443896 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.443978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444050 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444754 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.444980 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.445958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.446934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.447858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.448980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.449941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.450978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.451926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.452917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.453866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.454126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.454716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.454851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.455965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.456958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.457982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.458988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.459930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.460866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.461975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.462953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.463979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.464943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.465887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] role.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] role.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.466853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.467998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.468952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.469031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.469192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.469269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.469432 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.469518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.469742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.469831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.470097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.470213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.470358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.470492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.470614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.470748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.470868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.471984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.472959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.473996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.474126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.474284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.474400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.474547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.474637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.474802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.474889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.475853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.476957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.477980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.478973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.connection = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.479948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.480895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.481992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.482087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.482278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.482368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.482549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.482630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.482789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.482866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81455) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 19:13:52.483742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.483969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.484209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.484456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.484698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.484947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.485188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.485951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.486216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.486555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.486798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.487048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.487285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.487530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.487771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 30 19:13:52.487943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 30 19:13:52.514355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.514580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.514806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.517575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.517795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.518021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.524123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.526490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.552713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.552937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.554917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.555154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.605714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.606173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.654770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.654997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.655606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.655850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.810636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.810864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.810959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.811997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.835211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.835442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.835541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.835673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.835780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.835878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.835955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.836088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.836172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.836304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.836389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.836516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.836597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.836732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.848229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.848396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.861457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.861598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.861685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.861834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.861917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81455) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.862934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 30 19:13:52.879231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.879438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 19:13:52.879778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.879974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 19:13:52.880055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.880186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 19:13:52.880282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.880484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.880564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.880718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 30 19:13:52.880797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.880979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.881060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.881249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.881514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.881774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.890809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.891086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.891352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.891661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.891798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.892021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.892319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.892613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.898679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.899672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.901568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.901854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.902171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.902456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.902619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.902737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.902909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.903000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.903197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.903273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.903485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.903564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.903750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.903830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.904019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.904098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.904282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.904371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.904558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.904832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.905108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.905378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.928058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.929513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.929596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.929796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.931135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.931424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.934472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.934756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.935035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.936222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.936516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.936805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.941463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.941751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.943341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.943634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.947389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.947688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.947973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.948260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.948540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.948819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.949089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.949342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.949424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.949647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.949943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.950274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.950561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.950846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.951126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.951403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.964811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.965091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.966962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.967252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.968933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.971615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.972730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.973022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.974855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.975157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.977211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.979376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.980386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.982557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:52.983619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.983917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.984199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.984478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.984760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.985032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.986020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.986346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.986639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.986929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.987227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:52.987518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.001409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.001692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.001956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.002248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.004038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.004332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.004604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.004871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.009049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.010895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.012049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.012430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.012705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.013631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.015198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.015385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.015471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.015679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.015960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.016239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.016684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.018242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.018541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.018827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.019116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.019520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.027842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.028127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.028403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.028678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.029051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.029330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.029620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.030822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.031113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.031399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.031680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.032565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.032957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.033251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.045571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.048756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.048904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.051950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.052043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.054628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.054628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.054801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.054870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.057083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.057276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.057720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.058011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.058433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.061610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.063087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.065700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.066517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.066914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.067199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.067284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.067475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.070137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.070533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.070823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.071107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.075308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.075599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.075878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.079534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.080112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.080404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.083319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81455) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.083605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.083888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.084162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.084434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.084706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.084980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.085265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.085533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.085815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.086151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.086430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.086693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.086967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81455) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.087387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 30 19:13:53.087679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.087967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.088250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.088530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.088813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.089091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.089385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.089670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.089942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.090313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.090597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.090867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.091148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 30 19:13:53.121169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649b8af19c0 pid: 81455 (default app) Sep 30 19:13:53.132032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1459-4fe2-4532-a0fa-f17dd59ae92c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:13:53.132032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1459-4fe2-4532-a0fa-f17dd59ae92c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:13:53.132032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1459-4fe2-4532-a0fa-f17dd59ae92c None None] PATH_INFO: `/v3` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:13:53.132621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649b8af19c0 pid: 81454 (default app) Sep 30 19:13:53.133179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Fri Sep 30 19:13:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:13:59.930758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6176706-9853-43d5-9945-d382d82cc5bf None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:13:59.931272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6176706-9853-43d5-9945-d382d82cc5bf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:13:59.931378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6176706-9853-43d5-9945-d382d82cc5bf None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:13:59.935602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:13:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:13:59.941330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:13:59.941894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:13:59.941894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:00.014321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: INFO dbcounter [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] Registered counter for database keystone Sep 30 19:14:00.033454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG oslo_db.sqlalchemy.engines [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81455) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:14:00.039733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writer thread running {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:14:00.226165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG passlib.handlers.bcrypt [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81455) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 19:14:00.226475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG passlib.handlers.bcrypt [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81455) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 19:14:00.284655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:00.286304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:00.415088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:13:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 30 19:14:00.919345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6176706-9853-43d5-9945-d382d82cc5bf None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:00.989111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: INFO dbcounter [None req-a6176706-9853-43d5-9945-d382d82cc5bf None None] Registered counter for database keystone Sep 30 19:14:01.010483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG oslo_db.sqlalchemy.engines [None req-a6176706-9853-43d5-9945-d382d82cc5bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 30 19:14:01.017284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writer thread running {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 30 19:14:01.135172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6176706-9853-43d5-9945-d382d82cc5bf None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:01.139366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14614b-cb16-4a03-8f20-e311d4664aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:01.139991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14614b-cb16-4a03-8f20-e311d4664aef admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:01.140269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14614b-cb16-4a03-8f20-e311d4664aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:01.140539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14614b-cb16-4a03-8f20-e311d4664aef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:01.149182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14614b-cb16-4a03-8f20-e311d4664aef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:01.202776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ee14614b-cb16-4a03-8f20-e311d4664aef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 19:14:01.203043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14614b-cb16-4a03-8f20-e311d4664aef admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:01.213487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Fri Sep 30 19:14:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:14:01.219685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:01.236309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84dc90-b0d1-4768-ac4a-87566ecccb26 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:01.240745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06c985-794b-40d7-885a-33f7c1a37ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:01.241850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c985-794b-40d7-885a-33f7c1a37ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:01.242162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c985-794b-40d7-885a-33f7c1a37ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:01.242437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06c985-794b-40d7-885a-33f7c1a37ba7 admin admin] PATH_INFO: `/v3/projects/6d3b383133b449569f26f949e441f7e5` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:01.244041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06c985-794b-40d7-885a-33f7c1a37ba7 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d3b383133b449569f26f949e441f7e5)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:01.297358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5c06c985-794b-40d7-885a-33f7c1a37ba7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 30 19:14:01.297704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06c985-794b-40d7-885a-33f7c1a37ba7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:01.302262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Fri Sep 30 19:14:01 2022] GET /identity/v3/projects/6d3b383133b449569f26f949e441f7e5 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:03.414736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020024ea-bac7-45d6-b52f-95be0ee16c62 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:03.415323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020024ea-bac7-45d6-b52f-95be0ee16c62 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:03.415323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020024ea-bac7-45d6-b52f-95be0ee16c62 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:03.419324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:03.424746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18fd2f-786a-4a8f-8cf6-83623bcb5e64 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:03.425138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18fd2f-786a-4a8f-8cf6-83623bcb5e64 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:03.425289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18fd2f-786a-4a8f-8cf6-83623bcb5e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:03.445539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5f18fd2f-786a-4a8f-8cf6-83623bcb5e64 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:03.447289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5f18fd2f-786a-4a8f-8cf6-83623bcb5e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:03.455311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 30 19:14:03.723130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020024ea-bac7-45d6-b52f-95be0ee16c62 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:03.735653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020024ea-bac7-45d6-b52f-95be0ee16c62 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:03.739857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03686cc9-d336-43dd-a828-de01c8f6a0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:03.740457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686cc9-d336-43dd-a828-de01c8f6a0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:03.740737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686cc9-d336-43dd-a828-de01c8f6a0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:03.741009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03686cc9-d336-43dd-a828-de01c8f6a0e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:03.748615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03686cc9-d336-43dd-a828-de01c8f6a0e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:03.751164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03686cc9-d336-43dd-a828-de01c8f6a0e4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:03.760212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Fri Sep 30 19:14:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:14:03.765546 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18fd2f-786a-4a8f-8cf6-83623bcb5e64 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:03.774684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18fd2f-786a-4a8f-8cf6-83623bcb5e64 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:03.778959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e6b46-e39c-4943-9c19-84d1aacf4350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:03.779576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6b46-e39c-4943-9c19-84d1aacf4350 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:03.779852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6b46-e39c-4943-9c19-84d1aacf4350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:03.780121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e6b46-e39c-4943-9c19-84d1aacf4350 admin admin] PATH_INFO: `/v3/users/f75c03e5ed174ef098321b91fb4a9510` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:03.781738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e6b46-e39c-4943-9c19-84d1aacf4350 admin admin] RBAC: Authorizing `identity:get_user(user_id=f75c03e5ed174ef098321b91fb4a9510)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:03.783585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e6b46-e39c-4943-9c19-84d1aacf4350 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:03.785084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Fri Sep 30 19:14:03 2022] GET /identity/v3/users/f75c03e5ed174ef098321b91fb4a9510 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:06.027071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6e971-3352-4956-b506-22ac40812a07 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.027619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6e971-3352-4956-b506-22ac40812a07 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.027619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6e971-3352-4956-b506-22ac40812a07 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.028931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:06.035042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265fdd-cdd0-4c58-8572-3780cd4dd749 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.035460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265fdd-cdd0-4c58-8572-3780cd4dd749 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.035708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a265fdd-cdd0-4c58-8572-3780cd4dd749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.042939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b628a5d-4482-4c82-a538-beb55f1301e7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.043218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b628a5d-4482-4c82-a538-beb55f1301e7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.043487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b628a5d-4482-4c82-a538-beb55f1301e7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.044756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:06.050039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.050346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.050616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.054442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5a265fdd-cdd0-4c58-8572-3780cd4dd749 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:06.055616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5a265fdd-cdd0-4c58-8572-3780cd4dd749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:06.094247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG passlib.handlers.bcrypt [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81454) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 30 19:14:06.094674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG passlib.handlers.bcrypt [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81454) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 30 19:14:06.138545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:06.143789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:06.145370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:06.245141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:06.410114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265fdd-cdd0-4c58-8572-3780cd4dd749 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:06.434478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:06.507070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:06.518893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a265fdd-cdd0-4c58-8572-3780cd4dd749 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:06.552137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:06.552767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.553045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.553323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.565188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:06.574153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:06.575267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:06.576122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:06.583489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:06.607707 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08017e-e677-460f-b965-4651f7ac4e28 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:06.609986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:06.645843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:06.646736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.647014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.647280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.663391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:06.681553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa25baf-f419-492b-8b58-f92de62d2b8f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:06.714398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:06.714809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:06.715406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.715685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.715957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.716059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:06.716616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:06.716916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:06.718319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:06.729804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:06.736119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:06.813800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:14:06.819375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:06.822035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:06.834655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad8655-fe3c-41c7-a4d4-f32ba2e281c4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:06.868848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:06.869507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.869782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.870084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] PATH_INFO: `/v3/users/f75c03e5ed174ef098321b91fb4a9510` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.871212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] RBAC: Authorizing `identity:get_user(user_id=f75c03e5ed174ef098321b91fb4a9510)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:06.872674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:06.874263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:06 2022] GET /identity/v3/users/f75c03e5ed174ef098321b91fb4a9510 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:06.881539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:06.897385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:06.922325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abc20d-5dd6-423b-a7ee-fe15a63165f8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:06.962157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:06.963135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:06.963419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:06.963739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:06.985662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:06.987167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:06.991192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641bb1-fa1d-43a9-ba20-dfcb99d6aa8e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:14:07.006631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:07.007618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:14:07.008687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:14:07.008687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:14:07.008687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:07.008687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:07.013799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:07.027101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:07.027732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:07.028012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:07.028280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:07.029392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:07.030915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:07.032878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:07.038478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:07.072901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:07.126892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef11d2d-ac22-4ee4-a93e-20316e0762de None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:07.131192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:07.152213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae894e14-88fe-4105-8e12-ec33ab6e5602 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:07.167306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3938e-e1b5-4dcd-8e8a-de73d9a79f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:07.168090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3938e-e1b5-4dcd-8e8a-de73d9a79f2d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:07.168373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3938e-e1b5-4dcd-8e8a-de73d9a79f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:07.168650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3938e-e1b5-4dcd-8e8a-de73d9a79f2d None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:07.169310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3938e-e1b5-4dcd-8e8a-de73d9a79f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:07.169842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3938e-e1b5-4dcd-8e8a-de73d9a79f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:07.172434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3938e-e1b5-4dcd-8e8a-de73d9a79f2d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:07.189864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e576d72-cfa0-4262-a24b-e9a9e8201395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:07.190507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576d72-cfa0-4262-a24b-e9a9e8201395 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:07.190851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576d72-cfa0-4262-a24b-e9a9e8201395 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:07.191123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e576d72-cfa0-4262-a24b-e9a9e8201395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:07.191931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:07.192049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e576d72-cfa0-4262-a24b-e9a9e8201395 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.domain.id=default, user.id=f75c03e5ed174ef098321b91fb4a9510) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:07.192144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e576d72-cfa0-4262-a24b-e9a9e8201395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:07.193587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e576d72-cfa0-4262-a24b-e9a9e8201395 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:07.201492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1322 bytes} [Fri Sep 30 19:14:07 2022] GET /identity/v3/role_assignments?user.id=f75c03e5ed174ef098321b91fb4a9510&scope.domain.id=default&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:09.860008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75c17-d808-4655-9543-6a2616b52c1c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:09.860618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75c17-d808-4655-9543-6a2616b52c1c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:09.860618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a75c17-d808-4655-9543-6a2616b52c1c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:09.861927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:09.867959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418089f1-5f99-4ef2-a8fd-ed1505801648 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:09.868453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418089f1-5f99-4ef2-a8fd-ed1505801648 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:09.868725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418089f1-5f99-4ef2-a8fd-ed1505801648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:09.891844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-418089f1-5f99-4ef2-a8fd-ed1505801648 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:09.893070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-418089f1-5f99-4ef2-a8fd-ed1505801648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:09.988403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:10.041422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bdb6-97c0-45e9-9be6-8f4b67fa1ccb None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:10.041775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bdb6-97c0-45e9-9be6-8f4b67fa1ccb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:10.042091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72bdb6-97c0-45e9-9be6-8f4b67fa1ccb None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:10.043590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:10.067684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb0c0-250d-4b51-8c8d-5cd03b90f7de None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:10.068267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb0c0-250d-4b51-8c8d-5cd03b90f7de None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:10.068740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfb0c0-250d-4b51-8c8d-5cd03b90f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:10.091901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9cdfb0c0-250d-4b51-8c8d-5cd03b90f7de None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:10.093957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9cdfb0c0-250d-4b51-8c8d-5cd03b90f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:10.191872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:10.318905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca190e-2120-4ff8-baac-61f8bf8238b6 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:10.319273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca190e-2120-4ff8-baac-61f8bf8238b6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:10.319469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca190e-2120-4ff8-baac-61f8bf8238b6 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:10.320873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 13/26] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:10.326097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f28b54-bdec-4216-b2b8-9e78c0db6480 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:10.326640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f28b54-bdec-4216-b2b8-9e78c0db6480 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:10.327119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f28b54-bdec-4216-b2b8-9e78c0db6480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:10.339087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:10.351661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f8f28b54-bdec-4216-b2b8-9e78c0db6480 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:10.353109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f8f28b54-bdec-4216-b2b8-9e78c0db6480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:10.451658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca190e-2120-4ff8-baac-61f8bf8238b6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:10.453593 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:10.607294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca190e-2120-4ff8-baac-61f8bf8238b6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:10.610895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babcf1-3d88-477d-8e14-628e43d78325 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:10.611189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babcf1-3d88-477d-8e14-628e43d78325 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:10.611471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03babcf1-3d88-477d-8e14-628e43d78325 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:10.612820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:10.625509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3b30-894f-4300-ba31-f864f3076ce1 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:10.625797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3b30-894f-4300-ba31-f864f3076ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:10.626087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add3b30-894f-4300-ba31-f864f3076ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:10.646419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:10.660459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2add3b30-894f-4300-ba31-f864f3076ce1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:10.661672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2add3b30-894f-4300-ba31-f864f3076ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:10.678306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:10.678938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:10.679222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:10.679500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:10.680198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:10.683073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:10.819712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 16/29] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:10.820586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3b30-894f-4300-ba31-f864f3076ce1 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:10.846584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 14/30] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 30 19:14:10 2022] POST /identity/v3/roles => generated 219 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:14:10.915469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:10.960005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:10.973784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add3b30-894f-4300-ba31-f864f3076ce1 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.029566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.030253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.031071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.031353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.066430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:11.079264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:11.080177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:11.081399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 17/31] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:11.090741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:11.209013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8248a-246d-4540-9562-a9c6190abd80 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.267555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.268231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.268516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.268794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.272602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc6773-ca15-44ac-b77a-fa071259fcd2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.286813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:11.290650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:11.300820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:11.313494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.314129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.314411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.314685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:14:11.314967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:11.315802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:14:11.316615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:14:11.316615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:14:11.316615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:11.316783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:11.316783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:11.317310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:11.318862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 15/32] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:11.320025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:11.327047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:11.328567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:11.362531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:11.451328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d72cc-61a2-4074-aed0-bf55b8bb9e69 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.455601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4549-dc9f-49bb-8fc2-d5105e5b031d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.486235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.486853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.487137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.487414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.488056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:11.488365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:11.489737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:11.494572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb4364-0b72-463b-ae09-29ce4437e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.495359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4364-0b72-463b-ae09-29ce4437e443 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.495784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4364-0b72-463b-ae09-29ce4437e443 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.496222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4364-0b72-463b-ae09-29ce4437e443 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.497040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4364-0b72-463b-ae09-29ce4437e443 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:11.498587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4364-0b72-463b-ae09-29ce4437e443 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:11.508114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 19/34] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:11.510976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:11.516052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 16/35] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 30 19:14:11 2022] POST /identity/v3/roles => generated 225 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:11.517409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597df5f9-5016-4b31-9ed4-4d5645d3d895 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.517704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597df5f9-5016-4b31-9ed4-4d5645d3d895 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.517981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597df5f9-5016-4b31-9ed4-4d5645d3d895 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.519447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 17/36] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:11.523738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597df5f9-5016-4b31-9ed4-4d5645d3d895 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:11.579507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:11.649370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122e7e-0971-4db7-a2d5-f58ff6854cf1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.662882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:11.681279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597df5f9-5016-4b31-9ed4-4d5645d3d895 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.701318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7967290-074f-479d-a2cc-92d1519406c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.703004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967290-074f-479d-a2cc-92d1519406c9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.703813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967290-074f-479d-a2cc-92d1519406c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.704331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967290-074f-479d-a2cc-92d1519406c9 None admin] PATH_INFO: `/v3/users/f75c03e5ed174ef098321b91fb4a9510` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.706872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7967290-074f-479d-a2cc-92d1519406c9 None admin] RBAC: Authorizing `identity:get_user(user_id=f75c03e5ed174ef098321b91fb4a9510)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:11.708747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7967290-074f-479d-a2cc-92d1519406c9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:11.711701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 20/37] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:11 2022] GET /identity/v3/users/f75c03e5ed174ef098321b91fb4a9510 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:11.713773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42ade-b1ea-4b28-a43e-a7743b181910 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.714460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42ade-b1ea-4b28-a43e-a7743b181910 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.715039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e42ade-b1ea-4b28-a43e-a7743b181910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.728461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.728957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.729242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.729519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.731057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:11.732456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:11.738969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d9e42ade-b1ea-4b28-a43e-a7743b181910 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:11.740106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d9e42ade-b1ea-4b28-a43e-a7743b181910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:11.777265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 18/38] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:14:11 2022] POST /identity/v3/projects => generated 301 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:11.777811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:11.859713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 21/39] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:11.869441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd80f96-7841-482d-aa89-30391e38a36e None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.869738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd80f96-7841-482d-aa89-30391e38a36e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.870918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd80f96-7841-482d-aa89-30391e38a36e None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.878129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 22/40] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:11.879867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532256fd-a648-4053-8a4c-86df93dcff88 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.880160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532256fd-a648-4053-8a4c-86df93dcff88 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.880438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532256fd-a648-4053-8a4c-86df93dcff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.903483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-532256fd-a648-4053-8a4c-86df93dcff88 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:11.904725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-532256fd-a648-4053-8a4c-86df93dcff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:11.916969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc725-c8b0-45e8-afa3-b03748673526 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:11.956040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:11.966271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:11.967038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:11.967317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:11.967753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:11.969321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:11.971467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:11.973319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 19/41] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:11.978717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:11.991911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:11.992461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 23/42] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:12.103802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6cd67-4a99-4193-ab74-c2bb8da8f3f1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:12.139802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532256fd-a648-4053-8a4c-86df93dcff88 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:12.141348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:12.142013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:12.142320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:12.142637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] PATH_INFO: `/v3/domains/default/users/f75c03e5ed174ef098321b91fb4a9510/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:12.144871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f75c03e5ed174ef098321b91fb4a9510, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:12.146387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:12.163132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1361 bytes} [Fri Sep 30 19:14:11 2022] PUT /identity/v3/domains/default/users/f75c03e5ed174ef098321b91fb4a9510/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:14:12.262764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532256fd-a648-4053-8a4c-86df93dcff88 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:12.264977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:12.303993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b09f-9f75-4511-89e3-cc0209485e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:12.304620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b09f-9f75-4511-89e3-cc0209485e2a None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:12.304895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b09f-9f75-4511-89e3-cc0209485e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:12.305160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b09f-9f75-4511-89e3-cc0209485e2a None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:12.306078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b09f-9f75-4511-89e3-cc0209485e2a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:12.307274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b09f-9f75-4511-89e3-cc0209485e2a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:12.356273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:12.394477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd6152-ab49-486a-82e1-0c0119596c09 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:12.434450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:12.435039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:12.435365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:12.435736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:12.437405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:12.439060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:12.440755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 21/44] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:12.446575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:12.541474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 24/45] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 30 19:14:12 2022] POST /identity/v3/roles => generated 223 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:14:12.557678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6fafa-2836-4134-bdc7-1039da7940a5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:12.594849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d014-93a6-4861-b2f8-22e73810f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:12.595478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d014-93a6-4861-b2f8-22e73810f841 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:12.595757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d014-93a6-4861-b2f8-22e73810f841 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:12.596034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d014-93a6-4861-b2f8-22e73810f841 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:12.596711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d014-93a6-4861-b2f8-22e73810f841 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:12.598244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d014-93a6-4861-b2f8-22e73810f841 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:12.604441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:12.635497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 22/46] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:14:12 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:14:14.351097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671108d-5e65-40e0-835b-942fbfbb0718 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:14.351586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671108d-5e65-40e0-835b-942fbfbb0718 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:14.351586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671108d-5e65-40e0-835b-942fbfbb0718 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:14.352911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:14.358306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936e9b-2207-4d13-8260-b2b533efead4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:14.359210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936e9b-2207-4d13-8260-b2b533efead4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:14.359636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09936e9b-2207-4d13-8260-b2b533efead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:14.378273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-09936e9b-2207-4d13-8260-b2b533efead4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:14.379804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-09936e9b-2207-4d13-8260-b2b533efead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:14.447076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:14.722332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671108d-5e65-40e0-835b-942fbfbb0718 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:14.757938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:14.782975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4ed6-abe4-4188-a4d3-8fb347b08a2b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:14.783265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4ed6-abe4-4188-a4d3-8fb347b08a2b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:14.783541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f4ed6-abe4-4188-a4d3-8fb347b08a2b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:14.785020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 24/49] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:14.789849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ec23-b662-4024-a52e-09f32dacf7fa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:14.790196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ec23-b662-4024-a52e-09f32dacf7fa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:14.790481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237ec23-b662-4024-a52e-09f32dacf7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:14.809064 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4237ec23-b662-4024-a52e-09f32dacf7fa None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:14.810281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4237ec23-b662-4024-a52e-09f32dacf7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:14.829254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671108d-5e65-40e0-835b-942fbfbb0718 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:14.863159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:14.863783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:14.864063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:14.864337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:14.875195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:14.876577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 25/50] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:14.880263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:14.881280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:14.882112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:14.887286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ec23-b662-4024-a52e-09f32dacf7fa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:14.933646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:14.988695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237ec23-b662-4024-a52e-09f32dacf7fa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:15.028215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:15.028816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:15.029094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:15.029366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:15.030030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:15.030494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:15.031864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:15.043139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 26/52] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:15.050710 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:15.141875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:15.149015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2432b-2b7c-4261-b439-bc6e1c5e7f14 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:15.152888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:15.183399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:15.184027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:15.184306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:15.184582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] PATH_INFO: `/v3/users/f75c03e5ed174ef098321b91fb4a9510` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:15.185777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] RBAC: Authorizing `identity:get_user(user_id=f75c03e5ed174ef098321b91fb4a9510)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:15.188064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:15.189635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:15 2022] GET /identity/v3/users/f75c03e5ed174ef098321b91fb4a9510 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:15.194921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:15.253671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5259a2-b6f1-4031-aebf-5adab31dda02 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:15.264436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:15.294681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:15.294943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f575c0f-c9a2-465f-8e90-a7bd71fe5cae None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:15.295323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:15.295609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:15.296397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:15.297545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:15.299047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:15.300629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 27/54] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:15.306027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:15.333990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:15.334656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:15.334942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:15.335217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:15.336436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:15.337898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:15.339512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:15.345753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:15.375056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:15.412385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20e5db-f709-41ad-b106-eaae922d6460 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:15.447433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf75024-3103-4a79-abc2-b859e3365785 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:15.484341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e1f6f-0894-4271-8b49-2b85fe313ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:15.484954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1f6f-0894-4271-8b49-2b85fe313ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:15.485231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1f6f-0894-4271-8b49-2b85fe313ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:15.485503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e1f6f-0894-4271-8b49-2b85fe313ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:15.486260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e1f6f-0894-4271-8b49-2b85fe313ba1 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.domain.id=default, user.id=f75c03e5ed174ef098321b91fb4a9510) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:15.486568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e1f6f-0894-4271-8b49-2b85fe313ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:15.488053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e1f6f-0894-4271-8b49-2b85fe313ba1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:15.494604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1322 bytes} [Fri Sep 30 19:14:15 2022] GET /identity/v3/role_assignments?user.id=f75c03e5ed174ef098321b91fb4a9510&scope.domain.id=default&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:15.555171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddb192-af62-4060-a780-ac5c6ea6b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:15.555798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddb192-af62-4060-a780-ac5c6ea6b652 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:15.556073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddb192-af62-4060-a780-ac5c6ea6b652 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:15.556342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddb192-af62-4060-a780-ac5c6ea6b652 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:15.557021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddb192-af62-4060-a780-ac5c6ea6b652 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:15.558565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddb192-af62-4060-a780-ac5c6ea6b652 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:15.588247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Fri Sep 30 19:14:15 2022] POST /identity/v3/projects => generated 298 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:14:17.804745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5a3cd-99d7-43b6-aac7-d734a541384f None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:17.805252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5a3cd-99d7-43b6-aac7-d734a541384f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:17.805336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5a3cd-99d7-43b6-aac7-d734a541384f None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:17.806674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:17.812743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff4e4d-e1f9-4f79-a58b-489d8e51f6a7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:17.813144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff4e4d-e1f9-4f79-a58b-489d8e51f6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:17.813288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff4e4d-e1f9-4f79-a58b-489d8e51f6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:17.831374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-49ff4e4d-e1f9-4f79-a58b-489d8e51f6a7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:17.832557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-49ff4e4d-e1f9-4f79-a58b-489d8e51f6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:17.855037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:17.898535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:18.164997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5a3cd-99d7-43b6-aac7-d734a541384f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:18.261350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:18.269516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5a3cd-99d7-43b6-aac7-d734a541384f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:18.303322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d9c1e-acb3-463c-9871-10c771388329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:18.303939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d9c1e-acb3-463c-9871-10c771388329 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:18.304221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d9c1e-acb3-463c-9871-10c771388329 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:18.304495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d9c1e-acb3-463c-9871-10c771388329 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:18.305590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d9c1e-acb3-463c-9871-10c771388329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:18.307066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d9c1e-acb3-463c-9871-10c771388329 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:18.308681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:18.314321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff4e4d-e1f9-4f79-a58b-489d8e51f6a7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:18.411180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff4e4d-e1f9-4f79-a58b-489d8e51f6a7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:18.443581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1b9a-80b4-42a1-a571-8b69eae468cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:18.444180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b9a-80b4-42a1-a571-8b69eae468cc None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:18.444461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b9a-80b4-42a1-a571-8b69eae468cc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:18.444736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b9a-80b4-42a1-a571-8b69eae468cc None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:18.445376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1b9a-80b4-42a1-a571-8b69eae468cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:18.446837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1b9a-80b4-42a1-a571-8b69eae468cc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:18.473016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:14:18 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:21.862929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1045-df34-4593-ae8b-e2cd4f7a3d2f None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:21.863987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1045-df34-4593-ae8b-e2cd4f7a3d2f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:21.864480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e1045-df34-4593-ae8b-e2cd4f7a3d2f None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:21.866043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:21.871466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad579b-ca76-4c02-861c-5182e6254ecd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:21.872289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad579b-ca76-4c02-861c-5182e6254ecd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:21.872772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad579b-ca76-4c02-861c-5182e6254ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:21.903551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a2ad579b-ca76-4c02-861c-5182e6254ecd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:21.905313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a2ad579b-ca76-4c02-861c-5182e6254ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:21.919739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:21.921648 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c5a5-4d1c-4089-99c5-9cdf0193c50d None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:21.921940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c5a5-4d1c-4089-99c5-9cdf0193c50d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:21.922324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c5a5-4d1c-4089-99c5-9cdf0193c50d None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:21.923978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 33/63] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:21.929120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871470-7a9b-4c3d-888f-5ec7d5460441 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:21.929408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871470-7a9b-4c3d-888f-5ec7d5460441 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:21.929684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6871470-7a9b-4c3d-888f-5ec7d5460441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:21.958626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f6871470-7a9b-4c3d-888f-5ec7d5460441 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:21.961063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f6871470-7a9b-4c3d-888f-5ec7d5460441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:22.034127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 31/64] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:22.103247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 34/65] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:22.177198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a5ae-04f0-4ee8-a40e-7b2465c6d85c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.177500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a5ae-04f0-4ee8-a40e-7b2465c6d85c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.177675 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a5ae-04f0-4ee8-a40e-7b2465c6d85c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.179414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 32/66] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:22.185306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512a4c2-2ae8-4fe2-82b9-ed30cb3fe2ef None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.185605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512a4c2-2ae8-4fe2-82b9-ed30cb3fe2ef None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.185990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512a4c2-2ae8-4fe2-82b9-ed30cb3fe2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.210409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b512a4c2-2ae8-4fe2-82b9-ed30cb3fe2ef None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:22.211618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b512a4c2-2ae8-4fe2-82b9-ed30cb3fe2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:22.297549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5977-e6d3-49cb-a11a-b6c8f8db6790 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.297888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5977-e6d3-49cb-a11a-b6c8f8db6790 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.298128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5977-e6d3-49cb-a11a-b6c8f8db6790 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.299682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:22.305625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 35/68] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:22.310837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd097c-d0a3-4153-b64a-bf4bdc6681ca None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.311127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd097c-d0a3-4153-b64a-bf4bdc6681ca None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.311405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd097c-d0a3-4153-b64a-bf4bdc6681ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.348626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4dbd097c-d0a3-4153-b64a-bf4bdc6681ca None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:22.349824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4dbd097c-d0a3-4153-b64a-bf4bdc6681ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:22.361191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512a4c2-2ae8-4fe2-82b9-ed30cb3fe2ef None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:22.422953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:22.495824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:22.497060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8548c-e600-4829-b1ef-c22830ae8502 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.500158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8548c-e600-4829-b1ef-c22830ae8502 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.500158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8548c-e600-4829-b1ef-c22830ae8502 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.500158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 35/70] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:22.507100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660989-7772-46df-95f1-c731690fd4ae None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.508320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660989-7772-46df-95f1-c731690fd4ae None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.508320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7660989-7772-46df-95f1-c731690fd4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.522080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512a4c2-2ae8-4fe2-82b9-ed30cb3fe2ef None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:22.546386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e7660989-7772-46df-95f1-c731690fd4ae None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:22.547615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e7660989-7772-46df-95f1-c731690fd4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:22.580414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:22.581948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.582616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.583105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.613747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:22.618751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:22.619656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:22.620473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 36/71] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:22.621124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:22.653217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 36/72] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:22.662981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660989-7772-46df-95f1-c731690fd4ae None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:22.674954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:22.715174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:22.737582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1bf6-9285-40d9-ba2a-41ad688f9583 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:22.779387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:22.780251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.780539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.780816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.811365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:22.818028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:22.818916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:22.823096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:22.848737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7660989-7772-46df-95f1-c731690fd4ae None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:22.890342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:22.890969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.891506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.891858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.905296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:22.914220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:22.915107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:22.915903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:14:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:22.916553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:22.955048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248039-e5cf-49e5-aa78-1eaf4c1b1476 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:22.983939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:22.989374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:22.989983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:22.990306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:22.990578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:22.991237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:22.991539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:22.992926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.000911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.001698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.006836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.021157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d5a33-1ced-4d6d-b7c4-9a63906dc284 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.057973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.059168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.059454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.059731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.061622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.063122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.064838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 38/76] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.065434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.108563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4daeda-9a2b-4d52-b5d1-f1fd620b3149 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.142007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.142647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.142930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.143209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.143875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:23.144180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.145615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.153868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.154788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.164190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ec7e-af87-4d0f-bdb0-cff53f5c128d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.197724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.198381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.198677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.198947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.199609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:23.199910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.201285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.202685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.211032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.211804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.223038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.259842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3858dc-0273-4ec9-9161-4e948d48a042 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.292925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.293556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.293843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.294152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.304483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:23.309789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:23.311406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:23.312192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:23.312833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.313081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141170e3-37e9-43fd-b85f-0925616137b4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.348837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.349479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.349750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.350026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] PATH_INFO: `/v3/users/f75c03e5ed174ef098321b91fb4a9510` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.351195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] RBAC: Authorizing `identity:get_user(user_id=f75c03e5ed174ef098321b91fb4a9510)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.352656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.359134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/users/f75c03e5ed174ef098321b91fb4a9510 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.359134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.410707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a58e0-a600-4edc-8031-63c7388dbe22 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.420082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.437190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.446479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.447091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.447368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.447641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.448277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.449731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.457991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03d3e4-59c7-4851-b973-d110c5fe3468 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.476821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 41/81] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:14:23 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:23.477700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.501746 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.502446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.502749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.520927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.522511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.524236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.525018 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.597716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbcb7-9993-40ba-8293-9bef428ce89d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.634786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.635447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.635726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.635997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.637179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.638707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.640183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc06e-8acc-4089-be4d-7ee4532f73e5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.640981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.646297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.671035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.686639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.687264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.687550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.687829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.688503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:23.688813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.690848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.700263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:23.702436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:23.706907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.767993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba96f37-6485-44cc-8dea-aaae7c989575 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.812671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.813671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.813982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.814274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.836233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f7181-1f14-461a-8e45-34d853b97c2e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:23.880847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:23.882330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:23.883337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:23.883790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:23.905098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.907329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.947679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:23.968617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:23.970621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:23.975795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:24.044995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 43/85] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:24.046113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.103099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:24.104910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.158333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00d7ee-92e7-4317-99e5-fae9e8db1ffa None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.196200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:24.197220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:24.197708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:24.198213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:24.209331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:24.227019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:24.228522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68082e6-5b61-472b-abde-f02597c0c17e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.279174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:24.281022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:24.281931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:24.282729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:24.284118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:24.286677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:24.288299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:24.289042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 44/87] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:24.290288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:24.291275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.404352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 44/88] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:24.405282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.442762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7b30-d52b-4bf5-8882-0d231b03fa62 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.470719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:24.481217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:24.481850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:24.482215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:24.483023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:24.484247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:24.485702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:24.487727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:24.488330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.513107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:24.546076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20441378-68ce-4ab5-85f3-173aabc3e042 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.584791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:24.585155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:24.585353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:24.585623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:24.586770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:24.588296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:24.590033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 45/90] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:24.590825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.620374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d41aeb-64b4-4fab-8a38-cb0b1df24ca6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.668179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:24.669174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:24.669683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:24.671466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:24.696430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea6371-c12e-4112-b570-4b7b8efea4dd None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.714989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:24.740304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:24.741271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:24.741756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:24.742789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:24.744420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:24.747031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:24.750718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:24.751761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.763963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:24.766543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:24.789643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:24.873947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ac6b7-3240-4265-b1be-ba772e1fc81a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.883550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 46/92] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:24.883550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.918568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:24.919537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:24.920703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:24.921338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:24.922324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=22e698822779475e97944863e83b7475, user.id=f75c03e5ed174ef098321b91fb4a9510) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:24.922840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:24.924650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:24.931380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 47/93] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/role_assignments?user.id=f75c03e5ed174ef098321b91fb4a9510&scope.project.id=22e698822779475e97944863e83b7475&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:24.932560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:24.986857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05223587-9b83-4ce1-b19f-291be1743d4a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:24.993645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:25.011803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:25.029107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:25.030443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:25.030727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:25.030992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:25.031754 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, scope.project.id=22e698822779475e97944863e83b7475, user.id=c80b3f74e31e4f3ca3cd505bd487d055) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:25.032380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:25.033614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:25.042508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/role_assignments?user.id=c80b3f74e31e4f3ca3cd505bd487d055&scope.project.id=22e698822779475e97944863e83b7475&role.id=101229ee973c472f99780a668e4c403f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:25.043396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:25.070111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6316cc-5553-4e25-88a9-be0e3af6ce3f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:25.110654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:25.111661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:25.112147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:25.112682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:25.113705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] RBAC: Adding query filter params (role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=22e698822779475e97944863e83b7475, user.id=c80b3f74e31e4f3ca3cd505bd487d055) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:25.114269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:25.115943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:25.122958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:24 2022] GET /identity/v3/role_assignments?user.id=c80b3f74e31e4f3ca3cd505bd487d055&scope.project.id=22e698822779475e97944863e83b7475&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:25.238571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b912ad-1908-4430-8eb7-8082f0f1cd6d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:25.280160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc3f74-b6f7-4ef7-9504-cd5f49256ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:25.280822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3f74-b6f7-4ef7-9504-cd5f49256ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:25.281113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3f74-b6f7-4ef7-9504-cd5f49256ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:25.281393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc3f74-b6f7-4ef7-9504-cd5f49256ee8 None admin] PATH_INFO: `/v3/projects/df6647add3914044b46caffd53dd2227` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:25.282623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc3f74-b6f7-4ef7-9504-cd5f49256ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=df6647add3914044b46caffd53dd2227)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:25.284109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc3f74-b6f7-4ef7-9504-cd5f49256ee8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:25.286173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:25 2022] GET /identity/v3/projects/df6647add3914044b46caffd53dd2227 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:25.292286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:25.445963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dedf2b-0cc3-4841-94b6-33918ad0eb28 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:25.461694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:25.491299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc5ba2-ab45-4dde-911b-211ed794f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:25.492339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5ba2-ab45-4dde-911b-211ed794f449 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:25.492824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5ba2-ab45-4dde-911b-211ed794f449 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:25.493298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5ba2-ab45-4dde-911b-211ed794f449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:25.494257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc5ba2-ab45-4dde-911b-211ed794f449 None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, scope.project.id=df6647add3914044b46caffd53dd2227, user.id=c80b3f74e31e4f3ca3cd505bd487d055) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:25.494801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc5ba2-ab45-4dde-911b-211ed794f449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:25.496472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc5ba2-ab45-4dde-911b-211ed794f449 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:25.510187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 49/97] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:25 2022] GET /identity/v3/role_assignments?user.id=c80b3f74e31e4f3ca3cd505bd487d055&scope.project.id=df6647add3914044b46caffd53dd2227&role.id=101229ee973c472f99780a668e4c403f => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:26.281311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ae13-af86-4f2e-bc17-7b5d48373402 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:26.281818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ae13-af86-4f2e-bc17-7b5d48373402 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:26.281928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92ae13-af86-4f2e-bc17-7b5d48373402 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:26.283390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 49/98] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:26.284721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded678-6e83-4a12-9b79-41e970000c4c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:26.285097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded678-6e83-4a12-9b79-41e970000c4c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:26.285268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ded678-6e83-4a12-9b79-41e970000c4c None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:26.286725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 50/99] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:26.291798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dad9-268b-4cda-ad9c-1d54c185b1bf None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:26.292085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dad9-268b-4cda-ad9c-1d54c185b1bf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:26.292368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dad9-268b-4cda-ad9c-1d54c185b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:26.292474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe615e-969d-45f8-b831-492c6bb9bc3b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:26.292959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe615e-969d-45f8-b831-492c6bb9bc3b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:26.293431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe615e-969d-45f8-b831-492c6bb9bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:26.311924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4be8dad9-268b-4cda-ad9c-1d54c185b1bf None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:26.313252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4be8dad9-268b-4cda-ad9c-1d54c185b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:26.323078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8cbe615e-969d-45f8-b831-492c6bb9bc3b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:26.324605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8cbe615e-969d-45f8-b831-492c6bb9bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:26.423681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 51/100] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:26.424064 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:26.446273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 50/101] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:26.739300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8dad9-268b-4cda-ad9c-1d54c185b1bf None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:26.873781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8dad9-268b-4cda-ad9c-1d54c185b1bf None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:26.884972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:26.917674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:26.918347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:26.918634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:26.918913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:26.934898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:26.939792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:26.940642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:26.941439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 52/102] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:26.946775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe615e-969d-45f8-b831-492c6bb9bc3b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:26.953676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:27.082018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597a02c-5e44-4527-8201-275cf59ed824 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:27.156459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:27.157547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:27.158075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:27.158565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:27.160026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:27.161676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:27.163784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 53/103] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:27.169593 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:27.180855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe615e-969d-45f8-b831-492c6bb9bc3b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:27.231115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:27.248499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:27.249206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:27.249455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:27.249721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:27.250421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:27.250725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:27.252162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:27.270591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 51/104] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:27.280626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:27.330611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8a517-69df-4a8b-a860-b440a51baa46 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:27.366675 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:27.390844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:27.391813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:27.392311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:27.392783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:27.393662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:27.395586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:27.458165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 54/105] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:14:27 2022] POST /identity/v3/projects => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:14:27.473447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29e259-3654-4b21-9e70-14c88a1f56a0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:27.513698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:27.514404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:27.514684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:27.514957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] PATH_INFO: `/v3/users/d62bf7f8b29f4312a911208e67645d86` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:27.530252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] RBAC: Authorizing `identity:get_user(user_id=d62bf7f8b29f4312a911208e67645d86)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:27.531843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:27.533768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 52/106] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:27 2022] GET /identity/v3/users/d62bf7f8b29f4312a911208e67645d86 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:27.539162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:27.661513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:27.681526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d1578-2322-438b-b1ea-08976b9e367a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:27.730941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72d716-5eb0-4343-8af7-7af226914d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:27.731914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72d716-5eb0-4343-8af7-7af226914d5e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:27.733161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72d716-5eb0-4343-8af7-7af226914d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:27.733621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72d716-5eb0-4343-8af7-7af226914d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:27.824637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72d716-5eb0-4343-8af7-7af226914d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:27.826251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72d716-5eb0-4343-8af7-7af226914d5e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:27.930731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:27.934136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 55/107] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:27.940439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:28.036885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93847-78b2-41d9-8916-742db8da73e6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.037233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93847-78b2-41d9-8916-742db8da73e6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.037456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae93847-78b2-41d9-8916-742db8da73e6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.039034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 56/108] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:28.044981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab0b3-21a1-4edc-be1c-b0da0ea8abf5 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.045275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab0b3-21a1-4edc-be1c-b0da0ea8abf5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.045574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab0b3-21a1-4edc-be1c-b0da0ea8abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.075052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a0769-00d7-4f4b-9a6f-c3a72e80bcd1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:28.077359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e0fab0b3-21a1-4edc-be1c-b0da0ea8abf5 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:28.078406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:28.078959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e0fab0b3-21a1-4edc-be1c-b0da0ea8abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:28.143241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:28.144127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.144552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.144966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.146546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:28.148170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:28.152160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 53/109] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:27 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:28.159373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:28.203368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 57/110] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:28.317441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad7dd6-c24a-46bb-9a67-885a726ac359 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:28.364286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc2c9b-3620-4587-91f1-65074a4d2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:28.365133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2c9b-3620-4587-91f1-65074a4d2619 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.365560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2c9b-3620-4587-91f1-65074a4d2619 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.366003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2c9b-3620-4587-91f1-65074a4d2619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.366930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2c9b-3620-4587-91f1-65074a4d2619 None admin] RBAC: Adding query filter params (role.id=92836588d6be40ee895e245779951b32, scope.project.id=22e698822779475e97944863e83b7475, user.id=d62bf7f8b29f4312a911208e67645d86) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:28.367896 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2c9b-3620-4587-91f1-65074a4d2619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:28.369536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2c9b-3620-4587-91f1-65074a4d2619 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:28.376498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 54/111] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:28 2022] GET /identity/v3/role_assignments?user.id=d62bf7f8b29f4312a911208e67645d86&scope.project.id=22e698822779475e97944863e83b7475&role.id=92836588d6be40ee895e245779951b32 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:28.456048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42fb4-bb86-46f1-9e23-76607a023d1f None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.456896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42fb4-bb86-46f1-9e23-76607a023d1f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.457322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42fb4-bb86-46f1-9e23-76607a023d1f None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.459070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 58/112] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:28.465313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeeb35-9139-45c0-b272-cba9aefb9ca1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.465944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeeb35-9139-45c0-b272-cba9aefb9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.467064 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeeb35-9139-45c0-b272-cba9aefb9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.491943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9aeeeb35-9139-45c0-b272-cba9aefb9ca1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:28.493163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9aeeeb35-9139-45c0-b272-cba9aefb9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:28.526723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:28.580559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 55/113] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:28.637270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42fb4-bb86-46f1-9e23-76607a023d1f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:28.678351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcf60-5f35-429d-856a-38d0e9fbcab4 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.678645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcf60-5f35-429d-856a-38d0e9fbcab4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.678907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fcf60-5f35-429d-856a-38d0e9fbcab4 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.680245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 56/114] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:28.699664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdfa6-97ad-4a7f-b89c-55367933bc51 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.699994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdfa6-97ad-4a7f-b89c-55367933bc51 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.700269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fdfa6-97ad-4a7f-b89c-55367933bc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.738224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-948fdfa6-97ad-4a7f-b89c-55367933bc51 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:28.739353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-948fdfa6-97ad-4a7f-b89c-55367933bc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:28.782838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42fb4-bb86-46f1-9e23-76607a023d1f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:28.810923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:28.834419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:28.835071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:28.835355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:28.835633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:28.855131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:28.860730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:28.861590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:28.862396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 59/115] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:28.868129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:28.897486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 57/116] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:28.976572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1495297-7e22-4a92-8d7d-875ecb7f76c3 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.016457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.016777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fdfa6-97ad-4a7f-b89c-55367933bc51 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.017019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.017313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.017588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.018307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:29.018620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:29.020080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:29.029980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 60/117] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:29.036263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.099171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:29.169832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87127a4a-b969-4d36-a206-4a16f8d51033 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.208670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bed428-cd01-4958-b9c3-21e328fe5d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.209324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed428-cd01-4958-b9c3-21e328fe5d63 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.209619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed428-cd01-4958-b9c3-21e328fe5d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.209902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed428-cd01-4958-b9c3-21e328fe5d63 None admin] PATH_INFO: `/v3/users/f75c03e5ed174ef098321b91fb4a9510` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.211128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bed428-cd01-4958-b9c3-21e328fe5d63 None admin] RBAC: Authorizing `identity:get_user(user_id=f75c03e5ed174ef098321b91fb4a9510)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:29.212599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bed428-cd01-4958-b9c3-21e328fe5d63 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:29.214221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 61/118] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/users/f75c03e5ed174ef098321b91fb4a9510 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:29.215962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e487e56-b691-43ec-859b-26e3dd0cdbfc None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.216254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e487e56-b691-43ec-859b-26e3dd0cdbfc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.217111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e487e56-b691-43ec-859b-26e3dd0cdbfc None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.219059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 62/119] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:29.223773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e487e56-b691-43ec-859b-26e3dd0cdbfc None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.267579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:29.278532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fdfa6-97ad-4a7f-b89c-55367933bc51 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.323495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a668645-a9a3-4948-be8b-146ac867b1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.324602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668645-a9a3-4948-be8b-146ac867b1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.325118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668645-a9a3-4948-be8b-146ac867b1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.325640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668645-a9a3-4948-be8b-146ac867b1f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.337548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a668645-a9a3-4948-be8b-146ac867b1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:29.338227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e487e56-b691-43ec-859b-26e3dd0cdbfc None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-5a668645-a9a3-4948-be8b-146ac867b1f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:29.343657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:29.344557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:29.345381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:29.347715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 58/120] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:29.352417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:29.354412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414c66-fbb6-4c63-b21a-943c3ab56566 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.354963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414c66-fbb6-4c63-b21a-943c3ab56566 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.355441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47414c66-fbb6-4c63-b21a-943c3ab56566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.374766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-47414c66-fbb6-4c63-b21a-943c3ab56566 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:29.375812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.376444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.376732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.377013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.377672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-47414c66-fbb6-4c63-b21a-943c3ab56566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:29.378176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:29.379629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:29.381519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 63/121] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:29.382378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.461645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 59/122] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:29.463032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414c66-fbb6-4c63-b21a-943c3ab56566 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.501567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915ddef-4550-445f-b458-07bdad76cf17 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.540339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.541360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.541874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.542429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.554968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:29.555645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:29.563390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:29.564288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:29.565126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:29.567881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 64/123] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:29.573539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.573658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47414c66-fbb6-4c63-b21a-943c3ab56566 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.609985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.610795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.611181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.611465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.612140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:29.612447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:29.613860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:29.615179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:29.624073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 60/124] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:29.624904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.743360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f63c4e-6ecb-46ca-9047-c7d7da97767f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.788291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a133e-5e9f-4e22-a43c-d7e67ab6278f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.802722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.803619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.804096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.804516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475/users/f75c03e5ed174ef098321b91fb4a9510/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.806680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] RBAC: Authorizing `identity:create_grant(project_id=22e698822779475e97944863e83b7475, user_id=f75c03e5ed174ef098321b91fb4a9510, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:29.808778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:29.825519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 65/125] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:29 2022] PUT /identity/v3/projects/22e698822779475e97944863e83b7475/users/f75c03e5ed174ef098321b91fb4a9510/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:29.834081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:29.945149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413869d-3cb2-4822-9379-92915673649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:29.945776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413869d-3cb2-4822-9379-92915673649e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:29.946974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413869d-3cb2-4822-9379-92915673649e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:29.947247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413869d-3cb2-4822-9379-92915673649e None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:29.947935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413869d-3cb2-4822-9379-92915673649e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:29.948240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413869d-3cb2-4822-9379-92915673649e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:29.949644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413869d-3cb2-4822-9379-92915673649e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:29.954755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:29.965508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ab8ac-19b1-4c71-b42e-fd050cd4ea84 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:29.976466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 61/126] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:29.977408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413869d-3cb2-4822-9379-92915673649e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.002508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:30.046837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.047502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.047790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.048067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.049497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:30.051185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:30.055186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 66/127] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:30.055186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.126248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413869d-3cb2-4822-9379-92915673649e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:30.177810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.178543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.178835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.179110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.191143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:30.197697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:30.198619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:30.199493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 62/128] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:30.200146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.224683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79c3b5-d93a-494f-a6cb-4349db015444 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:30.273804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:30.298792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.299451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.299733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.300008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.306872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:30.308304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:30.310658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 67/129] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:30 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:30.312470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.313033 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c7ca6-d744-48d1-ab3d-abfafc1edd5c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:30.349657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.350392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.350679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.350960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.352145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:30.353666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:30.355339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 63/130] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:30 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:30.356101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.383082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:30.493623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a5154-1655-4cf5-b90b-f1ac841eb6a2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:30.496146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a5570-15ac-4c69-b23a-3a4fd0527d85 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:30.554778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.555420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.555723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.555994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.557187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:30.558634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:30.561560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 64/131] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:30 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:30.562595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.566593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:30.577472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.578112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.578399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.578670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.579335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:30.579636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:30.581018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:30.601487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 68/132] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:30.602338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.726894 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcde38-33b7-4d59-8191-829a24c8dc29 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:30.779436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.780193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.785011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.785355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475/users/c80b3f74e31e4f3ca3cd505bd487d055/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.788684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=22e698822779475e97944863e83b7475, user_id=c80b3f74e31e4f3ca3cd505bd487d055, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:30.790165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:30.798393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:30.806423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250988-a9ca-43db-8dfc-5f01e89a335b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:30.817936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 65/133] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:30 2022] PUT /identity/v3/projects/22e698822779475e97944863e83b7475/users/c80b3f74e31e4f3ca3cd505bd487d055/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:30.818739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:30.884369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b248b21-2511-4c0d-9f5d-2345ecfae9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:30.885495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248b21-2511-4c0d-9f5d-2345ecfae9d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.886147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248b21-2511-4c0d-9f5d-2345ecfae9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.886866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248b21-2511-4c0d-9f5d-2345ecfae9d6 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475/users/c80b3f74e31e4f3ca3cd505bd487d055/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.895444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b248b21-2511-4c0d-9f5d-2345ecfae9d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=22e698822779475e97944863e83b7475, user_id=c80b3f74e31e4f3ca3cd505bd487d055, role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:30.899650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b248b21-2511-4c0d-9f5d-2345ecfae9d6 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:30.924731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 69/134] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:30 2022] PUT /identity/v3/projects/22e698822779475e97944863e83b7475/users/c80b3f74e31e4f3ca3cd505bd487d055/roles/e508ed31828645df8c584b7fbe1798e4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:30.934700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548bae-c79a-4ee8-8ab2-0778d87f05dc None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.936614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548bae-c79a-4ee8-8ab2-0778d87f05dc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.937105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548bae-c79a-4ee8-8ab2-0778d87f05dc None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:30.941001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 70/135] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:30 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:30.956606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:30.975250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508687a2-1eba-47e2-82c8-cc3efc70a6d9 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:30.975900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508687a2-1eba-47e2-82c8-cc3efc70a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:30.976411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508687a2-1eba-47e2-82c8-cc3efc70a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:31.018420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-508687a2-1eba-47e2-82c8-cc3efc70a6d9 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:31.022101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-508687a2-1eba-47e2-82c8-cc3efc70a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:31.070588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc404d99-cb13-47ea-ad47-4031b33917f8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:31.139836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:31.140485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:31.140769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:31.141046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:31.142327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:31.143883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:31.145849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 66/136] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:30 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:31.151652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:31.168053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 71/137] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:31.305552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd663c6-4985-4c39-92d7-b1325a5e6b09 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:31.338141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:31.348642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f36db6-05c1-4229-9ce1-21c0c671a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:31.349307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36db6-05c1-4229-9ce1-21c0c671a107 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:31.349594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36db6-05c1-4229-9ce1-21c0c671a107 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:31.349875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36db6-05c1-4229-9ce1-21c0c671a107 None admin] PATH_INFO: `/v3/projects/df6647add3914044b46caffd53dd2227` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:31.351088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f36db6-05c1-4229-9ce1-21c0c671a107 None admin] RBAC: Authorizing `identity:get_project(project_id=df6647add3914044b46caffd53dd2227)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:31.352589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f36db6-05c1-4229-9ce1-21c0c671a107 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:31.354378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 67/138] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:31 2022] GET /identity/v3/projects/df6647add3914044b46caffd53dd2227 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:31.363244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508687a2-1eba-47e2-82c8-cc3efc70a6d9 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:31.468952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:31.492495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508687a2-1eba-47e2-82c8-cc3efc70a6d9 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:31.511583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d2bd0-6053-4e19-becc-e3eeb3d60554 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:31.512078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d2bd0-6053-4e19-becc-e3eeb3d60554 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:31.512151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d2bd0-6053-4e19-becc-e3eeb3d60554 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:31.513544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 68/139] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:31.519330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ba99-dddc-4cb6-bc8f-dc9dd321d8bf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:31.519621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ba99-dddc-4cb6-bc8f-dc9dd321d8bf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:31.519903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ba99-dddc-4cb6-bc8f-dc9dd321d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:31.533532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:31.534229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:31.534509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:31.534783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] PATH_INFO: `/v3/projects/df6647add3914044b46caffd53dd2227/users/c80b3f74e31e4f3ca3cd505bd487d055/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:31.539296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] RBAC: Authorizing `identity:create_grant(project_id=df6647add3914044b46caffd53dd2227, user_id=c80b3f74e31e4f3ca3cd505bd487d055, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:31.540756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:31.567102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fc92ba99-dddc-4cb6-bc8f-dc9dd321d8bf None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:31.568274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 72/140] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:31 2022] PUT /identity/v3/projects/df6647add3914044b46caffd53dd2227/users/c80b3f74e31e4f3ca3cd505bd487d055/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:31.568670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fc92ba99-dddc-4cb6-bc8f-dc9dd321d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:31.638173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:31.667313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 69/141] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:31.795601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db473da1-468e-49fd-ab0f-c5db14aa58cf None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:31.842145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:31.846998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:31.847310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:31.847540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:31.848858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:31.850368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:31.852181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 73/142] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:31.863218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ba99-dddc-4cb6-bc8f-dc9dd321d8bf None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:31.983695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ba99-dddc-4cb6-bc8f-dc9dd321d8bf None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:32.010842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:32.016854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:32.022783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:32.023402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.023713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.024016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.024757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:32.026250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:32.052228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 70/143] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:14:31 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:32.059184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:32.217734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea19b93-2d36-43f5-b56a-c53de0656f56 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:32.256823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:32.257780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.258388 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.258668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.270425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:32.275418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:32.276303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:32.277188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 74/144] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:32.284803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:32.401535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae40c67-43d3-4348-8577-de0b92f99d88 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:32.440532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:32.441175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.441462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.441751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.442472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:32.442790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:32.444220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:32.454609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 71/145] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:32.460370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:32.546564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:32.570256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d66328-bfcf-4570-a3da-17fdd601835b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:32.607108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8cea-3ab3-4388-95ad-78a921582890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:32.607699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8cea-3ab3-4388-95ad-78a921582890 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.607981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8cea-3ab3-4388-95ad-78a921582890 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.608256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8cea-3ab3-4388-95ad-78a921582890 None admin] PATH_INFO: `/v3/users/d62bf7f8b29f4312a911208e67645d86` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.609400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8cea-3ab3-4388-95ad-78a921582890 None admin] RBAC: Authorizing `identity:get_user(user_id=d62bf7f8b29f4312a911208e67645d86)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:32.610885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8cea-3ab3-4388-95ad-78a921582890 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:32.617458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 75/146] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:32 2022] GET /identity/v3/users/d62bf7f8b29f4312a911208e67645d86 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:32.618975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:32.676921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:32.733847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec272b11-207d-4a8a-8f9c-547d6d1e6b85 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:32.761620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b5d1-4e70-49ce-b0c2-c51e9d3ac832 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.762131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b5d1-4e70-49ce-b0c2-c51e9d3ac832 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.762207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86b5d1-4e70-49ce-b0c2-c51e9d3ac832 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.764169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 76/147] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:32.769771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b396f-6703-4116-912d-830124f0eb98 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.770081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b396f-6703-4116-912d-830124f0eb98 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.770367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b396f-6703-4116-912d-830124f0eb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.770531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:32.771144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.771436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.771716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.773089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:32.774724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:32.776374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 72/148] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:32 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:32.783972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:32.796669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3e2b396f-6703-4116-912d-830124f0eb98 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:32.799813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3e2b396f-6703-4116-912d-830124f0eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:32.901689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc8f2c-93c2-489f-b32e-c9175f502a1c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:32.926417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:32.940843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 77/149] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:32.963699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:32.964377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:32.964660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:32.964932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475/users/d62bf7f8b29f4312a911208e67645d86/roles/92836588d6be40ee895e245779951b32` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:32.971367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] RBAC: Authorizing `identity:create_grant(project_id=22e698822779475e97944863e83b7475, user_id=d62bf7f8b29f4312a911208e67645d86, role_id=92836588d6be40ee895e245779951b32)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:32.972813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:32.993905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 73/150] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:32 2022] PUT /identity/v3/projects/22e698822779475e97944863e83b7475/users/d62bf7f8b29f4312a911208e67645d86/roles/92836588d6be40ee895e245779951b32 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:14:33.352261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b396f-6703-4116-912d-830124f0eb98 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:33.437949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:33.469974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b396f-6703-4116-912d-830124f0eb98 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:33.505700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:33.506374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:33.506652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:33.506922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:33.521377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:33.526586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:33.527445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:33.528222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 78/151] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:33.535760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:33.646241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc27dd0-1622-4bc6-948c-bcacf8308d0f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:33.683615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:33.684231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:33.684572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:33.684995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:33.685919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:33.686260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:33.687732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:33.696733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 74/152] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:33.703231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:33.832315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29e958-6081-4246-8172-1a4a8d421a82 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:33.875918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:33.883814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:33.884467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:33.884746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:33.885021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] PATH_INFO: `/v3/users/f75c03e5ed174ef098321b91fb4a9510` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:33.886274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] RBAC: Authorizing `identity:get_user(user_id=f75c03e5ed174ef098321b91fb4a9510)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:33.887747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:33.890210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 79/153] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:33 2022] GET /identity/v3/users/f75c03e5ed174ef098321b91fb4a9510 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:33.895511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:33.941307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:34.013831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ebf8-8bbc-4ce1-b384-13d27493d7b2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:34.054897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:34.054897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:34.054897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:34.055220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:34.133416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:34.134934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:34.179462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:34.249322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 75/154] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:34.254729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:34.397667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93b807-ee28-4468-b4bd-c62d31345076 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:34.445983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca69a0-bcc5-4190-9863-486d6e89fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:34.446660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca69a0-bcc5-4190-9863-486d6e89fb88 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:34.446939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca69a0-bcc5-4190-9863-486d6e89fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:34.447213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca69a0-bcc5-4190-9863-486d6e89fb88 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:34.448361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca69a0-bcc5-4190-9863-486d6e89fb88 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:34.449832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca69a0-bcc5-4190-9863-486d6e89fb88 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:34.451541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 80/155] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:34 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:34.457718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:34.598168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051b512-0087-419e-b518-1cbf1640a021 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:34.648088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe867462-7e11-4c38-92c7-e21aa7cb5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:34.648725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867462-7e11-4c38-92c7-e21aa7cb5a61 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:34.648952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867462-7e11-4c38-92c7-e21aa7cb5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:34.649217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe867462-7e11-4c38-92c7-e21aa7cb5a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:34.649937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe867462-7e11-4c38-92c7-e21aa7cb5a61 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=22e698822779475e97944863e83b7475, user.id=f75c03e5ed174ef098321b91fb4a9510) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:34.650263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe867462-7e11-4c38-92c7-e21aa7cb5a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:34.651683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe867462-7e11-4c38-92c7-e21aa7cb5a61 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:34.662943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 76/156] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:34 2022] GET /identity/v3/role_assignments?user.id=f75c03e5ed174ef098321b91fb4a9510&scope.project.id=22e698822779475e97944863e83b7475&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:34.678750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45443-43b4-4db0-acd5-5d60bc3be5e5 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:34.679069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45443-43b4-4db0-acd5-5d60bc3be5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:34.679297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a45443-43b4-4db0-acd5-5d60bc3be5e5 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:34.680656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 81/157] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:34.693283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdcbf-b51d-449c-8e40-a42490c549e4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:34.693600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdcbf-b51d-449c-8e40-a42490c549e4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:34.693837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffdcbf-b51d-449c-8e40-a42490c549e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:34.705974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:34.721989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0cffdcbf-b51d-449c-8e40-a42490c549e4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:34.723244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0cffdcbf-b51d-449c-8e40-a42490c549e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:34.811823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 77/158] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:35.062651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915e5da-c78e-4f9f-bcd5-bfa55d27cca9 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:35.063113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915e5da-c78e-4f9f-bcd5-bfa55d27cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:35.063262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915e5da-c78e-4f9f-bcd5-bfa55d27cca9 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:35.064688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 82/159] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:35.074116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e7bb-29a5-47e6-b938-33ebf556fd86 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:35.074407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e7bb-29a5-47e6-b938-33ebf556fd86 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:35.074679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e7bb-29a5-47e6-b938-33ebf556fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:35.100238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e452e7bb-29a5-47e6-b938-33ebf556fd86 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:35.101453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e452e7bb-29a5-47e6-b938-33ebf556fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:35.192581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 78/160] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:35.452252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915e5da-c78e-4f9f-bcd5-bfa55d27cca9 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:35.526366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:35.568154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915e5da-c78e-4f9f-bcd5-bfa55d27cca9 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:35.615044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:35.615695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:35.615976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:35.616249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:35.633235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:35.639013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:35.640111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:35.640937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:35.644573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 83/161] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:14:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:35.646171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452e7bb-29a5-47e6-b938-33ebf556fd86 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:35.717862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:35.767153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452e7bb-29a5-47e6-b938-33ebf556fd86 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:35.785432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:35.830318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:35.830936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:35.831244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:35.831493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:35.832170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:35.832474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:35.833877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:35.842857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 79/162] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:14:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:35.849961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:35.937869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71314e11-7568-4a82-8977-07fe5cee4d69 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:35.978511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:35.996509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a947471-3944-40c3-81c9-ac81c1ac8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:35.997690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947471-3944-40c3-81c9-ac81c1ac8c4a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:35.997977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947471-3944-40c3-81c9-ac81c1ac8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:35.998279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a947471-3944-40c3-81c9-ac81c1ac8c4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.014621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a947471-3944-40c3-81c9-ac81c1ac8c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-9a947471-3944-40c3-81c9-ac81c1ac8c4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:36.032010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:36.032944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:36.033756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 84/163] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:36.034959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abdda-e24a-49f0-9d4f-a8dc76005e87 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:36.034959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abdda-e24a-49f0-9d4f-a8dc76005e87 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:36.035224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abdda-e24a-49f0-9d4f-a8dc76005e87 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.037253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 85/164] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:36.042784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127f0e-9e93-4c9f-96a2-8ec900949a75 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:36.043067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127f0e-9e93-4c9f-96a2-8ec900949a75 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:36.043344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6127f0e-9e93-4c9f-96a2-8ec900949a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.070575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c6127f0e-9e93-4c9f-96a2-8ec900949a75 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:36.071771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c6127f0e-9e93-4c9f-96a2-8ec900949a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:36.134099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9470b9-0c3b-49aa-bc6f-1c43ab58dd4c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:36.174403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 86/165] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:36.175285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127f0e-9e93-4c9f-96a2-8ec900949a75 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:36.194421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:36.209643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:36.210300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:36.210582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:36.210857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.211978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:36.213483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:36.223615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 80/166] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:35 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:36.239195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:36.291275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6127f0e-9e93-4c9f-96a2-8ec900949a75 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:36.327712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:36.328335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:36.328615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:36.328889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.329565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:36.329864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:36.331322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:36.343609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 87/167] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:36.344713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:36.359099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:36.398406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbdaa7-dbc1-4ae1-94ee-089acb0ec90c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:36.454533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:36.455164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:36.455444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:36.455714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.525783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e996-9785-45b8-aa78-a8f4f1651a26 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:36.558458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:36.572077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:36.573546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:36.575667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:36.576375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:36.576672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:36.576941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.583430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:36.584941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:36.586686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 88/168] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:36 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:36.595170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:36.706455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:36.761004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8727e6-1cd2-4d60-bb04-66f6b2aeecb2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:36.800927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 81/169] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:36.801806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:36.812527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60f2e4-508b-449f-a92c-5e7c4052dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:36.813156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60f2e4-508b-449f-a92c-5e7c4052dccd None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:36.813444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60f2e4-508b-449f-a92c-5e7c4052dccd None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:36.813726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60f2e4-508b-449f-a92c-5e7c4052dccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:36.890950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60f2e4-508b-449f-a92c-5e7c4052dccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:36.892425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60f2e4-508b-449f-a92c-5e7c4052dccd None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:36.942478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:36.956392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:36.969426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7b304-3049-495a-84d8-088e4b984635 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:37.013722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:37.014764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.015244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.015877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.026856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:37.033357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:37.034285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:37.035171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:37.037742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 82/170] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:37.038758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:37.039885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 89/171] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:14:37.041163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879d9d-9c99-42b9-8732-e252c4cc9468 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.041449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879d9d-9c99-42b9-8732-e252c4cc9468 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.041722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84879d9d-9c99-42b9-8732-e252c4cc9468 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.047376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 90/172] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:37.048028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879d9d-9c99-42b9-8732-e252c4cc9468 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:37.186545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05602c97-7861-4da3-a9f3-93f9f75b3818 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:37.198435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84879d9d-9c99-42b9-8732-e252c4cc9468 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:37.230551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:37.232946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.233918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.234711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.236166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:37.237912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:37.240119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 83/173] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:37 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:37.241126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:37.246116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87e58b-a88a-47b1-92da-5500c3ff5419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:37.246809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87e58b-a88a-47b1-92da-5500c3ff5419 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.247323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87e58b-a88a-47b1-92da-5500c3ff5419 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.247929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87e58b-a88a-47b1-92da-5500c3ff5419 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.248545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87e58b-a88a-47b1-92da-5500c3ff5419 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:37.250062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87e58b-a88a-47b1-92da-5500c3ff5419 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:37.252178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 91/174] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:37 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:37.253471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb95c1-162c-4e36-9a06-2d00c11ef321 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.253751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb95c1-162c-4e36-9a06-2d00c11ef321 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.254022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb95c1-162c-4e36-9a06-2d00c11ef321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.273057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:37.274569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-86fb95c1-162c-4e36-9a06-2d00c11ef321 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:37.276240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-86fb95c1-162c-4e36-9a06-2d00c11ef321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:37.286096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:37.354154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 92/175] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:37.354154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53e7cf-ebbe-42f3-adbf-edfef04afe89 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.354154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53e7cf-ebbe-42f3-adbf-edfef04afe89 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.354154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53e7cf-ebbe-42f3-adbf-edfef04afe89 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.355446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 93/176] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:37.356276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53e7cf-ebbe-42f3-adbf-edfef04afe89 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:37.386241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e2f4a-ad72-4e52-9f30-2fb9f2661cc2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:37.453370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:37.454377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.457384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.457840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.458802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:37.459296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:37.460840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:37.475391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 84/177] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:37.476630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:37.567180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53e7cf-ebbe-42f3-adbf-edfef04afe89 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:37.574823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:37.599668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2df0bd-9152-4633-8756-6bed306fa13e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:37.641293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0fda6-4066-4a3e-901d-bcbbd1b4da2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:37.642250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0fda6-4066-4a3e-901d-bcbbd1b4da2f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.642727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0fda6-4066-4a3e-901d-bcbbd1b4da2f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.643216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0fda6-4066-4a3e-901d-bcbbd1b4da2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.644146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0fda6-4066-4a3e-901d-bcbbd1b4da2f None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, scope.project.id=22e698822779475e97944863e83b7475, user.id=c80b3f74e31e4f3ca3cd505bd487d055) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:37.644656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0fda6-4066-4a3e-901d-bcbbd1b4da2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:37.646298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0fda6-4066-4a3e-901d-bcbbd1b4da2f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:37.654255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 85/178] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:37 2022] GET /identity/v3/role_assignments?user.id=c80b3f74e31e4f3ca3cd505bd487d055&scope.project.id=22e698822779475e97944863e83b7475&role.id=101229ee973c472f99780a668e4c403f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:37.661400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:37.661400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.661400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.661400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.661792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] RBAC: Adding query filter params (role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=22e698822779475e97944863e83b7475, user.id=c80b3f74e31e4f3ca3cd505bd487d055) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:37.661792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:37.661792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:37.662591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d8796-6fa6-4d5d-a055-5b175c866d12 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.663157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d8796-6fa6-4d5d-a055-5b175c866d12 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.663816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d8796-6fa6-4d5d-a055-5b175c866d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.677614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 94/179] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:37 2022] GET /identity/v3/role_assignments?user.id=c80b3f74e31e4f3ca3cd505bd487d055&scope.project.id=22e698822779475e97944863e83b7475&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:37.678392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:37.686777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-192d8796-6fa6-4d5d-a055-5b175c866d12 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:37.688325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-192d8796-6fa6-4d5d-a055-5b175c866d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:37.708943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:37.780443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 86/180] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:37.781947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cee7d5-278a-4ddf-9f86-c4e71537aee0 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.782259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cee7d5-278a-4ddf-9f86-c4e71537aee0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.782542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cee7d5-278a-4ddf-9f86-c4e71537aee0 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.784078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 87/181] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:37.785044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae3a35-1bda-4df9-a957-eb66a466483a None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.785331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae3a35-1bda-4df9-a957-eb66a466483a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.785603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae3a35-1bda-4df9-a957-eb66a466483a None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.787458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 88/182] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:37.791837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1376-023a-402d-8d45-0bfa0898affb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.792116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1376-023a-402d-8d45-0bfa0898affb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.792386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb1376-023a-402d-8d45-0bfa0898affb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.819282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3bcb1376-023a-402d-8d45-0bfa0898affb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:37.820612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3bcb1376-023a-402d-8d45-0bfa0898affb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:37.847150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78db16-2201-454f-b12a-0fa3a70f4d97 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:37.922641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c07695-c4bb-4037-a0e9-106f3b8b317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:37.923215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07695-c4bb-4037-a0e9-106f3b8b317e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.923492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07695-c4bb-4037-a0e9-106f3b8b317e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.923764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c07695-c4bb-4037-a0e9-106f3b8b317e None admin] PATH_INFO: `/v3/users/c80b3f74e31e4f3ca3cd505bd487d055` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.925097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c07695-c4bb-4037-a0e9-106f3b8b317e None admin] RBAC: Authorizing `identity:get_user(user_id=c80b3f74e31e4f3ca3cd505bd487d055)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:37.926736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c07695-c4bb-4037-a0e9-106f3b8b317e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:37.928695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 95/183] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:37 2022] GET /identity/v3/users/c80b3f74e31e4f3ca3cd505bd487d055 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:37.930031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c159-5244-4c40-96fe-378bfee3bba6 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:37.930361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c159-5244-4c40-96fe-378bfee3bba6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:37.930603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2c159-5244-4c40-96fe-378bfee3bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:37.947890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 89/184] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:37.949071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1376-023a-402d-8d45-0bfa0898affb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:37.952408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-eae2c159-5244-4c40-96fe-378bfee3bba6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:37.953601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eae2c159-5244-4c40-96fe-378bfee3bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:37.958631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.049982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 96/185] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:38.050866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c159-5244-4c40-96fe-378bfee3bba6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.078406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.095602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb1376-023a-402d-8d45-0bfa0898affb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.140582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.141228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.141507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.141779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.154576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:38.159774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:38.160667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:38.161499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 90/186] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:38.162198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.199969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2c159-5244-4c40-96fe-378bfee3bba6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.252488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.259743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.260358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.260633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.260902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.297590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe04031-7623-4a0b-9b6d-5d918c3c1571 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.334820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.335453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.335726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.335992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.347470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:38.349996 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:38.351488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:38.352230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:38.353178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:38.353988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 91/187] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:38.355378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.364638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.458868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e764ca-3864-49f5-aaa5-ff983c673f46 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.459460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 97/188] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:38.459460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.490179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.499444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.500047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.500327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.500597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.501259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:38.501559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:38.502975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:38.511521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 92/189] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:38.513163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.560033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab042705-82ef-48f7-8fce-15a365895aac None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.568334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.597191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.597820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.598121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.598394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.599499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:38.600947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:38.602537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 98/190] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:38.602537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.614538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94767f-aa69-4073-a59d-1c56fa9c9d21 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.648788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.649391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.649669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.649947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.650628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:38.650930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:38.652295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:38.661440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 93/191] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:38.662267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.702946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aee11-3757-4a01-8405-bad0ee29bf5a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.711324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.736546 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.737173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.737455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.737729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.747665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:38.752544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:38.753599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 99/192] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:38.754466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.760914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b710c-daf1-4b68-a2da-5e42f9e08016 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.791157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.795737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.796461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.796809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.797149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] PATH_INFO: `/v3/projects/df6647add3914044b46caffd53dd2227` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.798712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] RBAC: Authorizing `identity:get_project(project_id=df6647add3914044b46caffd53dd2227)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:38.800182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:38.801806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 94/193] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/projects/df6647add3914044b46caffd53dd2227 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:38.802572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.860578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77e6fa-7241-42e8-a4cb-c97a54662021 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.894770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.895401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.895688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.895960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] PATH_INFO: `/v3/users/d62bf7f8b29f4312a911208e67645d86` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.897140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] RBAC: Authorizing `identity:get_user(user_id=d62bf7f8b29f4312a911208e67645d86)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:38.898623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:38.900201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 100/194] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/users/d62bf7f8b29f4312a911208e67645d86 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:38.900961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:38.901861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7004962-55f8-4a09-94df-b7ada3365b20 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:38.920257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:38.938242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:38.938852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:38.939133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:38.939409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:38.940059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:38.941493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:38.971283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 95/195] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:14:38 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:38.971283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.016701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553e4c3-460d-4c6f-8e2e-22fdd4d89a7e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.018756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.057840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.058616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.059422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.059422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] PATH_INFO: `/v3/users/419fc8740cf541e485ac303fcc2ab992` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.074440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] RBAC: Authorizing `identity:get_user(user_id=419fc8740cf541e485ac303fcc2ab992)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.076413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.078398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 101/196] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/users/419fc8740cf541e485ac303fcc2ab992 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:39.083866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.090195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e116de-5b7c-4b57-b56c-c3c74f855a24 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.141431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.142563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.142844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.143116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.143794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:39.144098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.145487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.154555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 96/197] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:14:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:39.156273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.195590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.208646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd79f3f-f0ff-46d4-9191-79b21e496dac None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.252726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.253264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.253541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.253807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.254634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, scope.project.id=df6647add3914044b46caffd53dd2227, user.id=c80b3f74e31e4f3ca3cd505bd487d055) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:39.254935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.256368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.266024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 102/198] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/role_assignments?user.id=c80b3f74e31e4f3ca3cd505bd487d055&scope.project.id=df6647add3914044b46caffd53dd2227&role.id=101229ee973c472f99780a668e4c403f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:39.266813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.285887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff7ad-d6cf-4215-8edc-4a5e8be09b77 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.303407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.330934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.332071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.332449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.333322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.423375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea869145-eb5d-41e4-bba6-0c01e0eb8d09 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.440890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.443433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.478425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.479595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.479884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.480159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.498488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.569546 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.571323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.578211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 97/199] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:39.579082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.602700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.684473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 103/200] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:39.685345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.691171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905d5dc-541e-47a6-807d-3b1dea44e58b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.732024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.732612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.732889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.733158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] PATH_INFO: `/v3/users/419fc8740cf541e485ac303fcc2ab992` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.734342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] RBAC: Authorizing `identity:get_user(user_id=419fc8740cf541e485ac303fcc2ab992)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.735779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.737367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 98/201] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/users/419fc8740cf541e485ac303fcc2ab992 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:39.738150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.741690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.796014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd432f-325f-411d-91d0-3dfcf076a2bf None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.822686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.833668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450f223-df60-4405-a771-10355336da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.834495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450f223-df60-4405-a771-10355336da43 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.835166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450f223-df60-4405-a771-10355336da43 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.835298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450f223-df60-4405-a771-10355336da43 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.836708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450f223-df60-4405-a771-10355336da43 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.838486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450f223-df60-4405-a771-10355336da43 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.840337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 104/202] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:39.843361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450f223-df60-4405-a771-10355336da43 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.863261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca9883-15a6-46d9-9c33-774aba13b379 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.902160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.903686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.904158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:39.904631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:39.906094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:39.907719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:39.909778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 99/203] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:39.915061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:39.957301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450f223-df60-4405-a771-10355336da43 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:39.991094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:39.998164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:39.999122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:39.999621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:40.000032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:40.024177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f3776-cb88-41da-a914-3479ed7db3b1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:40.070007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:40.072544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:40.073722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:40.074313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:40.074775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:40.076162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] RBAC: Adding query filter params (role.id=92836588d6be40ee895e245779951b32, scope.project.id=22e698822779475e97944863e83b7475, user.id=d62bf7f8b29f4312a911208e67645d86) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:40.076570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:40.078117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:40.082708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:40.084363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:40.090438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 100/204] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/role_assignments?user.id=d62bf7f8b29f4312a911208e67645d86&scope.project.id=22e698822779475e97944863e83b7475&role.id=92836588d6be40ee895e245779951b32 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:40.090438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:40.216527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667f471-d5ff-4a76-aec4-3312e52ebdf8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:40.295526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 105/205] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:40.302703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:40.305116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:40.305732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:40.306009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:40.306303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:40.307025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=419fc8740cf541e485ac303fcc2ab992) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:40.307331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:40.308802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:40.324585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:40.332116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 101/206] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:40 2022] GET /identity/v3/role_assignments?user.id=419fc8740cf541e485ac303fcc2ab992&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:40.411529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:40.423615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdb088-044f-4b87-829e-7d1ae2b603b2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:40.465316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80b95-5179-4ec3-a9a5-394eebd213a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:40.466921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80b95-5179-4ec3-a9a5-394eebd213a9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:40.467395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80b95-5179-4ec3-a9a5-394eebd213a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:40.467876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80b95-5179-4ec3-a9a5-394eebd213a9 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:40.469479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80b95-5179-4ec3-a9a5-394eebd213a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:40.471242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80b95-5179-4ec3-a9a5-394eebd213a9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:40.473824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 106/207] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:40 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:40.480123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:40.604076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a7935-7768-4303-b8ee-63fb268997fc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:40.642572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba614ee-42b4-4cbc-8fbc-ae3f031549eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:40.643561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba614ee-42b4-4cbc-8fbc-ae3f031549eb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:40.644065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba614ee-42b4-4cbc-8fbc-ae3f031549eb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:40.644557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba614ee-42b4-4cbc-8fbc-ae3f031549eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:40.645476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba614ee-42b4-4cbc-8fbc-ae3f031549eb None admin] RBAC: Adding query filter params (role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=419fc8740cf541e485ac303fcc2ab992) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:40.645994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba614ee-42b4-4cbc-8fbc-ae3f031549eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:40.647680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba614ee-42b4-4cbc-8fbc-ae3f031549eb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:40.654764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 102/208] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:40 2022] GET /identity/v3/role_assignments?user.id=419fc8740cf541e485ac303fcc2ab992&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:41.483260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cbf4-62c2-4755-b70c-4af76462c4cb None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:41.483753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cbf4-62c2-4755-b70c-4af76462c4cb None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:41.483753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cbf4-62c2-4755-b70c-4af76462c4cb None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:41.485310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 107/209] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:41.490660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe7cf-33af-4c84-a852-8666d20a00cb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:41.491046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe7cf-33af-4c84-a852-8666d20a00cb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:41.491205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe7cf-33af-4c84-a852-8666d20a00cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:41.510215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a9fbe7cf-33af-4c84-a852-8666d20a00cb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:41.511390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a9fbe7cf-33af-4c84-a852-8666d20a00cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:41.573102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588c17-75ec-4d16-93c2-7a1caf6a075b None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:41.573425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588c17-75ec-4d16-93c2-7a1caf6a075b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:41.573658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13588c17-75ec-4d16-93c2-7a1caf6a075b None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:41.574221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:41.575694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 108/210] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:41.581055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96232f1f-849b-43a6-bce6-7e7702062fd4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:41.581343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96232f1f-849b-43a6-bce6-7e7702062fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:41.581620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96232f1f-849b-43a6-bce6-7e7702062fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:41.586443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 103/211] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:41.599718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-96232f1f-849b-43a6-bce6-7e7702062fd4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:41.600900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-96232f1f-849b-43a6-bce6-7e7702062fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:41.672630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 109/212] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:41.869039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbe7cf-33af-4c84-a852-8666d20a00cb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:41.953036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96232f1f-849b-43a6-bce6-7e7702062fd4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:41.983005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbe7cf-33af-4c84-a852-8666d20a00cb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:42.027085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:42.028571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.028849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.029123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.043058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:42.049704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:42.050651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:42.051469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 104/213] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:42.059555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:42.073232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:42.087280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96232f1f-849b-43a6-bce6-7e7702062fd4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:42.126144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:42.138999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:42.140494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.141280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.141775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.144252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:42.145927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:42.153336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 110/214] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:42.154583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:42.181183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622b231-0bf3-4c63-afbc-edc1428a9a0a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:42.219836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:42.220451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.220999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.221282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.221951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:42.222302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:42.223698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:42.233304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 105/215] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:42.243078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:42.292694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f314bd7-9ae6-46a9-a538-6891ab0fc08f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:42.341768 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:42.343173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.343609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.344378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.345417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:42.347727 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:42.355340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb30511-b569-4203-9355-9b525cbe1d40 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:42.376029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:42.386603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 111/216] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:14:42 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:42.402284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6973eae-7f8e-4a44-8b8a-aeb09b1c9589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:42.403260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973eae-7f8e-4a44-8b8a-aeb09b1c9589 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.403643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973eae-7f8e-4a44-8b8a-aeb09b1c9589 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.403953 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6973eae-7f8e-4a44-8b8a-aeb09b1c9589 None admin] PATH_INFO: `/v3/users/436e5fb23df543b0a02937c0d4c34578` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.420839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6973eae-7f8e-4a44-8b8a-aeb09b1c9589 None admin] RBAC: Authorizing `identity:get_user(user_id=436e5fb23df543b0a02937c0d4c34578)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:42.422420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6973eae-7f8e-4a44-8b8a-aeb09b1c9589 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:42.424656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 106/217] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:42 2022] GET /identity/v3/users/436e5fb23df543b0a02937c0d4c34578 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:42.430402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:42.450579 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:42.563901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b8c9b-2fc1-4719-a358-a36ae8177520 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:42.604351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bd4a7-16e8-492c-a9a7-a21637a4ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:42.605351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd4a7-16e8-492c-a9a7-a21637a4ce60 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.605634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd4a7-16e8-492c-a9a7-a21637a4ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.606473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bd4a7-16e8-492c-a9a7-a21637a4ce60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.651524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c5dfd-91e0-4c19-a59f-edf98c29311b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.652418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c5dfd-91e0-4c19-a59f-edf98c29311b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.653526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c5dfd-91e0-4c19-a59f-edf98c29311b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.656912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 107/218] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:42.661907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7f124-b198-452e-9f33-852364a0c091 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.662277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7f124-b198-452e-9f33-852364a0c091 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.662555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7f124-b198-452e-9f33-852364a0c091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.684904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c2a7f124-b198-452e-9f33-852364a0c091 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:42.686137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c2a7f124-b198-452e-9f33-852364a0c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:42.687629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bd4a7-16e8-492c-a9a7-a21637a4ce60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:42.689121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bd4a7-16e8-492c-a9a7-a21637a4ce60 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:42.707027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:42.777217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 108/219] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:42.827859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 112/220] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:42.833671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7f124-b198-452e-9f33-852364a0c091 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:42.928486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5150-e664-4f1b-83be-f26f4d67ff30 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.928789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5150-e664-4f1b-83be-f26f4d67ff30 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.928964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc5150-e664-4f1b-83be-f26f4d67ff30 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.930605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 113/221] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:42.937189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7694ad-1944-4a46-938e-983b25b5ba7e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.937476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7694ad-1944-4a46-938e-983b25b5ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.937779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7694ad-1944-4a46-938e-983b25b5ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.946878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7f124-b198-452e-9f33-852364a0c091 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:42.949216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:42.958086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8a7694ad-1944-4a46-938e-983b25b5ba7e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:42.959301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8a7694ad-1944-4a46-938e-983b25b5ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:42.991809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:42.992878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:42.993359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:42.993828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:42.995631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:42.998011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:42.999957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 109/222] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:42 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:43.005937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.085394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 114/223] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:43.086292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7694ad-1944-4a46-938e-983b25b5ba7e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.160084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02df6a-83bf-4354-847e-03e999b44aa8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:43.173556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:43.201813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:43.202831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:43.203313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:43.203808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:43.204727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=436e5fb23df543b0a02937c0d4c34578) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:43.205038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:43.206517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:43.214107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 110/224] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/role_assignments?user.id=436e5fb23df543b0a02937c0d4c34578&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=101229ee973c472f99780a668e4c403f => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:43.280709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7694ad-1944-4a46-938e-983b25b5ba7e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:43.333963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:43.334684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:43.334964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:43.335236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:43.355077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:43.360807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:43.361767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:43.362625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 115/225] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:43.369613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.427434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:43.464750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.520861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0f670-f094-4865-b0df-4c0b874966be None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:43.562709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:43.563332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:43.563614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:43.563891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:43.564569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:43.564877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:43.566410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:43.577644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 111/226] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:43.578575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7614c2c-6847-4066-8bfd-6c5afa8c0453 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:43.583011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:43.584563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.640289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:43.640995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:43.641275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:43.641603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:43.664282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:43.670250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:43.671208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:43.672018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 116/227] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:43.679142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.711686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978aa5f-47b6-481d-b349-12498ec4f769 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:43.714389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:43.790529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:43.791088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:43.791371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:43.791647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] PATH_INFO: `/v3/users/419fc8740cf541e485ac303fcc2ab992` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:43.795265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] RBAC: Authorizing `identity:get_user(user_id=419fc8740cf541e485ac303fcc2ab992)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:43.796823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:43.799971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 112/228] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/users/419fc8740cf541e485ac303fcc2ab992 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:43.806144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.860149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2386a1-de5b-4252-bdcb-5553cca19076 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:43.905227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:43.905845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:43.906151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:43.906428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:43.907105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:43.907409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:43.911345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:43.929279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 117/229] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:43.938284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:43.972414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:44.041733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b030b3-497b-43a3-b8c6-4188e7ce6007 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:44.050355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f39886-b2c9-4320-9736-073618b28a61 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:44.089948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:44.091432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:44.091715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:44.091989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] PATH_INFO: `/v3/users/419fc8740cf541e485ac303fcc2ab992` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:44.093193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] RBAC: Authorizing `identity:get_user(user_id=419fc8740cf541e485ac303fcc2ab992)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:44.094757 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:44.096665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 118/230] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/users/419fc8740cf541e485ac303fcc2ab992 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:44.101779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:44.150747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:44.151630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:44.152081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:44.152490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:44.158736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:44.160358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:44.162486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 113/231] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:43 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:44.168172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:44.208471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:44.216405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb1796-f40f-4b2f-a1cc-535585bd0bba None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:44.257528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:44.258188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:44.258476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:44.258748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:44.259604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:44.260664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:44.263091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:44.272040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 119/232] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:44 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:44.279334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:44.355370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c015d-8cbb-490e-a16b-577bdf2011c6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:44.427504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e384e69-c468-4162-93ec-9374af880b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:44.428172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384e69-c468-4162-93ec-9374af880b58 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:44.428455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384e69-c468-4162-93ec-9374af880b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:44.428729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e384e69-c468-4162-93ec-9374af880b58 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49/users/419fc8740cf541e485ac303fcc2ab992/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:44.431860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e384e69-c468-4162-93ec-9374af880b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ea3421608452eae39510625fcfc49, user_id=419fc8740cf541e485ac303fcc2ab992, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:44.433321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e384e69-c468-4162-93ec-9374af880b58 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:44.447502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e7230-ec78-4f9a-b6ba-be40ad266020 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:44.458843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 114/233] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:44 2022] PUT /identity/v3/projects/3e2ea3421608452eae39510625fcfc49/users/419fc8740cf541e485ac303fcc2ab992/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:14:44.498283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efb5ce-9950-4756-b544-58a5f4c18d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:44.499027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb5ce-9950-4756-b544-58a5f4c18d68 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:44.499356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb5ce-9950-4756-b544-58a5f4c18d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:44.499683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efb5ce-9950-4756-b544-58a5f4c18d68 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49/users/419fc8740cf541e485ac303fcc2ab992/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:44.501977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efb5ce-9950-4756-b544-58a5f4c18d68 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ea3421608452eae39510625fcfc49, user_id=419fc8740cf541e485ac303fcc2ab992, role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:44.503658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efb5ce-9950-4756-b544-58a5f4c18d68 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:44.535009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 120/234] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:44 2022] PUT /identity/v3/projects/3e2ea3421608452eae39510625fcfc49/users/419fc8740cf541e485ac303fcc2ab992/roles/e508ed31828645df8c584b7fbe1798e4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:45.242028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1868-046e-4cf5-a47a-2d3bf1b51fa3 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:45.242582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1868-046e-4cf5-a47a-2d3bf1b51fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:45.242658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1868-046e-4cf5-a47a-2d3bf1b51fa3 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:45.244092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 115/235] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:45.250019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c166-1165-408b-9481-20b4a7966224 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:45.250894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c166-1165-408b-9481-20b4a7966224 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:45.251369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c166-1165-408b-9481-20b4a7966224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:45.275068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-6d02c166-1165-408b-9481-20b4a7966224 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:45.276557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6d02c166-1165-408b-9481-20b4a7966224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:45.295881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:45.340467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67a3b-3e3e-439a-8137-d4f2598fc11d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:45.341032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67a3b-3e3e-439a-8137-d4f2598fc11d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:45.341502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67a3b-3e3e-439a-8137-d4f2598fc11d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:45.343216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 116/236] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:45.356446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 121/237] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:45.361677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1196e-f742-4dbd-9734-f405ad7f02a3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:45.362210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1196e-f742-4dbd-9734-f405ad7f02a3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:45.362725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1196e-f742-4dbd-9734-f405ad7f02a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:45.382698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1df1196e-f742-4dbd-9734-f405ad7f02a3 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:45.384243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1df1196e-f742-4dbd-9734-f405ad7f02a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:45.463809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 117/238] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:45.733426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02c166-1165-408b-9481-20b4a7966224 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:45.844084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1196e-f742-4dbd-9734-f405ad7f02a3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:45.882310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:45.896802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02c166-1165-408b-9481-20b4a7966224 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:45.952322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41628f28-71b2-4fb7-8bf4-2d7e458bfbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:45.953330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628f28-71b2-4fb7-8bf4-2d7e458bfbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:45.953939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628f28-71b2-4fb7-8bf4-2d7e458bfbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:45.954409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628f28-71b2-4fb7-8bf4-2d7e458bfbb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:45.967360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41628f28-71b2-4fb7-8bf4-2d7e458bfbb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-41628f28-71b2-4fb7-8bf4-2d7e458bfbb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:45.974483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:45.975404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:45.976214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:45.978938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 122/239] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:45.980379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6f74f-ffff-4dfb-b650-25b7c9155136 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:45.981392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6f74f-ffff-4dfb-b650-25b7c9155136 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:45.981806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6f74f-ffff-4dfb-b650-25b7c9155136 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:45.984670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 123/240] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:45.985837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6f74f-ffff-4dfb-b650-25b7c9155136 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:45.997633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1196e-f742-4dbd-9734-f405ad7f02a3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:46.014448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:46.042405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90970d7d-2a0c-4365-81ac-01c1b5bdbc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:46.043337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90970d7d-2a0c-4365-81ac-01c1b5bdbc89 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.043829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90970d7d-2a0c-4365-81ac-01c1b5bdbc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.044285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90970d7d-2a0c-4365-81ac-01c1b5bdbc89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.046243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90970d7d-2a0c-4365-81ac-01c1b5bdbc89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:46.048281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90970d7d-2a0c-4365-81ac-01c1b5bdbc89 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:46.050324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 118/241] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:46.054883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918e03-9ed2-4433-9753-dac908d61181 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.055144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918e03-9ed2-4433-9753-dac908d61181 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.055418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a918e03-9ed2-4433-9753-dac908d61181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.081652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3a918e03-9ed2-4433-9753-dac908d61181 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:46.083202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3a918e03-9ed2-4433-9753-dac908d61181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:46.116726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6f74f-ffff-4dfb-b650-25b7c9155136 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:46.155817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:46.156808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.157287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.157759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.158780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:46.159308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:46.160953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:46.170271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 119/242] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:46.171111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 124/243] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:46.171593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918e03-9ed2-4433-9753-dac908d61181 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:46.179968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:46.196971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:46.267938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:46.282861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a918e03-9ed2-4433-9753-dac908d61181 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:46.297130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd99948-387a-4be3-86e0-9f07753670e3 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:46.320642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:46.321563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.321980 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.322434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.323278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:46.325651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:46.334568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:46.335467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.335860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.336368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] PATH_INFO: `/v3/users/f9913b544a2b43449d3a6e56d62fed71` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.350897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 120/244] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:14:46 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:46.352315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] RBAC: Authorizing `identity:get_user(user_id=f9913b544a2b43449d3a6e56d62fed71)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:46.353890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:46.357558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 125/245] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:46 2022] GET /identity/v3/users/f9913b544a2b43449d3a6e56d62fed71 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:46.362375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:46.455512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:46.480215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a10bd-ff13-4288-9a29-12d33f00f56c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:46.526829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:46.528312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.528790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.529256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.613578 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:46.615079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:46.647214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:46.713106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:46.745337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 121/246] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:46.752878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:46.819657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189b808-1ff3-44d4-b229-8b582ecc9e20 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:46.865550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:46.874106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:46.875632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.875913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.876186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.888643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed32fa-a353-4c33-9745-fb1611d0b091 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:46.891143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:46.896947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:46.897866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:46.898726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 126/247] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:46.905801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:46.938340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:46.939558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:46.940530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:46.941147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:46.942963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:46.945452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:46.948600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 122/248] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:46 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:46.957051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:47.025130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:47.069797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005788e-ccdc-4e54-9d59-1c725b7f8984 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:47.097902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd118e-ea52-4265-b033-2fa537ae73c5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:47.114117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:47.115045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.115642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.116086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.116938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:47.117414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:47.119146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:47.130951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 127/249] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:47.137553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:47.143161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adba8c3-3b35-4959-b321-6c52f074a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:47.148879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adba8c3-3b35-4959-b321-6c52f074a06e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.149452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adba8c3-3b35-4959-b321-6c52f074a06e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.149919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adba8c3-3b35-4959-b321-6c52f074a06e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.150912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adba8c3-3b35-4959-b321-6c52f074a06e None admin] RBAC: Adding query filter params (role.id=92836588d6be40ee895e245779951b32, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=f9913b544a2b43449d3a6e56d62fed71) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:47.151417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adba8c3-3b35-4959-b321-6c52f074a06e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:47.153649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adba8c3-3b35-4959-b321-6c52f074a06e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:47.164288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 123/250] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:46 2022] GET /identity/v3/role_assignments?user.id=f9913b544a2b43449d3a6e56d62fed71&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=92836588d6be40ee895e245779951b32 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:47.227856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:47.288515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c45a0-bf87-432b-bb06-d4f8e66e46a7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:47.337151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0635-20b3-4818-a032-1e5b099edb7b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.337651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0635-20b3-4818-a032-1e5b099edb7b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.337651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0635-20b3-4818-a032-1e5b099edb7b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.339239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 124/251] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:47.339692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:47.340586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.341255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.341742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] PATH_INFO: `/v3/users/436e5fb23df543b0a02937c0d4c34578` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.343227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] RBAC: Authorizing `identity:get_user(user_id=436e5fb23df543b0a02937c0d4c34578)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:47.344966 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:47.346965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 128/252] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:47 2022] GET /identity/v3/users/436e5fb23df543b0a02937c0d4c34578 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:47.352896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:47.353329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9e740-e5da-4324-9124-767822857d25 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.353612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9e740-e5da-4324-9124-767822857d25 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.353886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9e740-e5da-4324-9124-767822857d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.395120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4ed9e740-e5da-4324-9124-767822857d25 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:47.396317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4ed9e740-e5da-4324-9124-767822857d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:47.516317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4299c-89e8-4033-a80b-c33230e4f863 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:47.544534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:47.561652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb967f-b2e7-44cf-91cf-2de14e8ef10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:47.562332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb967f-b2e7-44cf-91cf-2de14e8ef10e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.562615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb967f-b2e7-44cf-91cf-2de14e8ef10e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.562892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb967f-b2e7-44cf-91cf-2de14e8ef10e None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.564708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 125/253] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:47.565388 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb967f-b2e7-44cf-91cf-2de14e8ef10e None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:47.566896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb967f-b2e7-44cf-91cf-2de14e8ef10e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:47.568583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 129/254] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:47 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:47.575888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9e740-e5da-4324-9124-767822857d25 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:47.591470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15311b85-ce0e-41e3-8ef8-488a3eb4f130 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.591747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15311b85-ce0e-41e3-8ef8-488a3eb4f130 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.591935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15311b85-ce0e-41e3-8ef8-488a3eb4f130 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.593425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 130/255] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:47.599053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8616d5-f8f6-410b-a49a-4ca4f5795f50 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.599334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8616d5-f8f6-410b-a49a-4ca4f5795f50 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.599604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8616d5-f8f6-410b-a49a-4ca4f5795f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.635070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-aa8616d5-f8f6-410b-a49a-4ca4f5795f50 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:47.636252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-aa8616d5-f8f6-410b-a49a-4ca4f5795f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:47.638619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:47.695043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9e740-e5da-4324-9124-767822857d25 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:47.743557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:47.744234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:47.744513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:47.744788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49/users/436e5fb23df543b0a02937c0d4c34578/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:47.748058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ea3421608452eae39510625fcfc49, user_id=436e5fb23df543b0a02937c0d4c34578, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:47.749580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:47.775298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 126/256] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:47 2022] PUT /identity/v3/projects/3e2ea3421608452eae39510625fcfc49/users/436e5fb23df543b0a02937c0d4c34578/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:47.780547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 131/257] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:48.086984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:48.207520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:48.211143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc2ff-4c4f-453a-957b-9ed16dfd2f89 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:48.254358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:48.254987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:48.255261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:48.255527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:48.271832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:48.276650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:48.278119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:48.279605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 127/258] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:14:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:48.284537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8616d5-f8f6-410b-a49a-4ca4f5795f50 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:48.287014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:48.477156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8616d5-f8f6-410b-a49a-4ca4f5795f50 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:48.500111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd16baa-6b1d-4e9d-888c-0a2d6219f812 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:48.530360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:48.572143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:48.572772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:48.573055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:48.573330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:48.575082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:48.575419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:48.578285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:48.593208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:48.593848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:48.594150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:48.594422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:48.603995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 132/259] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:48.614831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:48.638692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:48.644362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:48.645330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:48.646179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 128/260] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:14:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:48.651555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:48.711213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:48.840621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24200654-c5df-4bfd-8816-ddfb2e9a88fe None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:48.856551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e1ebc-43e2-4e14-a9b9-928df197b6bb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:48.893636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:48.894681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:48.895176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:48.895641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:48.896509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:48.897005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:48.898624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:48.918076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 129/261] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:14:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:48.924115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:48.938297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:48.939272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:48.939794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:48.940262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] PATH_INFO: `/v3/users/419fc8740cf541e485ac303fcc2ab992` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:48.946716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] RBAC: Authorizing `identity:get_user(user_id=419fc8740cf541e485ac303fcc2ab992)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:48.948402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:48.950897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 133/262] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:48 2022] GET /identity/v3/users/419fc8740cf541e485ac303fcc2ab992 => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:48.957025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:49.074115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:49.094029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:49.109823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58a61b-3346-4bc8-a417-e7f922e24109 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:49.144985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:49.145959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.146465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.146933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] PATH_INFO: `/v3/users/419fc8740cf541e485ac303fcc2ab992` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.148286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] RBAC: Authorizing `identity:get_user(user_id=419fc8740cf541e485ac303fcc2ab992)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:49.150044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:49.151871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 130/263] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:48 2022] GET /identity/v3/users/419fc8740cf541e485ac303fcc2ab992 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:49.164548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:49.177847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b331dcb-aeda-49ea-9638-529bb769c569 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:49.252160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:49.252741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.253022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.253296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.272808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e407c40-75e8-4971-a70e-294f06cfd0ff None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:49.309426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:49.310926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.311409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.311875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.342457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:49.388400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:49.390698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:49.454043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:49.455557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:49.499359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 131/264] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:14:49.507308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:49.537541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:49.610510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:49.631303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 134/265] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:49.637810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:49.684005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693fce-8a68-45f7-885b-efdcb7c68d76 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:49.739573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:49.740600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.741071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.741612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.747150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:49.748900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:49.750828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 132/266] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:49 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:49.757088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:49.846737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925020bb-4708-4fd5-9aeb-8c0f95d17d87 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:49.924366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa9ffb-0789-473e-be11-97c73cf99ef1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:49.930765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba567ede-d581-43d4-8788-78747d5e8f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:49.931417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba567ede-d581-43d4-8788-78747d5e8f0c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.931696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba567ede-d581-43d4-8788-78747d5e8f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.931967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba567ede-d581-43d4-8788-78747d5e8f0c None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.933165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba567ede-d581-43d4-8788-78747d5e8f0c None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:49.934833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba567ede-d581-43d4-8788-78747d5e8f0c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:49.936727 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 135/267] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:49 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:49.937867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3b4a-4500-437b-91e0-0299c8652f2c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.938171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3b4a-4500-437b-91e0-0299c8652f2c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.938445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe3b4a-4500-437b-91e0-0299c8652f2c None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.939631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 136/268] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:49.943655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:49.951294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe3b4a-4500-437b-91e0-0299c8652f2c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:49.963271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c91e-f192-4d61-9a48-a6abf1f8910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:49.963882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c91e-f192-4d61-9a48-a6abf1f8910b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.964165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c91e-f192-4d61-9a48-a6abf1f8910b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.964440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c91e-f192-4d61-9a48-a6abf1f8910b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.965495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c91e-f192-4d61-9a48-a6abf1f8910b None admin] RBAC: Adding query filter params (role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=419fc8740cf541e485ac303fcc2ab992) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:49.965810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c91e-f192-4d61-9a48-a6abf1f8910b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:49.967341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c91e-f192-4d61-9a48-a6abf1f8910b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:49.973773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 133/269] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:49 2022] GET /identity/v3/role_assignments?user.id=419fc8740cf541e485ac303fcc2ab992&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:49.975068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41267d-4dae-436d-bd6d-a7d86a6be52b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:49.975357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41267d-4dae-436d-bd6d-a7d86a6be52b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:49.975632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41267d-4dae-436d-bd6d-a7d86a6be52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:49.995835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fe41267d-4dae-436d-bd6d-a7d86a6be52b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:49.997117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fe41267d-4dae-436d-bd6d-a7d86a6be52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:50.007580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:50.076037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:50.077356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9344-ef75-4b97-b33f-b317eea8d784 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.077644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9344-ef75-4b97-b33f-b317eea8d784 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.077989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd9344-ef75-4b97-b33f-b317eea8d784 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.079348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 135/271] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:50.093827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947a670-c3eb-4ea0-821d-0bf4966d33ef None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.094204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947a670-c3eb-4ea0-821d-0bf4966d33ef None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.094411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947a670-c3eb-4ea0-821d-0bf4966d33ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.135295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e947a670-c3eb-4ea0-821d-0bf4966d33ef None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:50.137388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e947a670-c3eb-4ea0-821d-0bf4966d33ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:50.247369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe3b4a-4500-437b-91e0-0299c8652f2c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:50.284255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 136/272] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 30 19:14:50.311284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f687c-64bc-4161-b521-21ba19a64e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:50.311895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f687c-64bc-4161-b521-21ba19a64e20 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.312169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f687c-64bc-4161-b521-21ba19a64e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.312441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f687c-64bc-4161-b521-21ba19a64e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.313158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f687c-64bc-4161-b521-21ba19a64e20 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=419fc8740cf541e485ac303fcc2ab992) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:50.313464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f687c-64bc-4161-b521-21ba19a64e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:50.314922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f687c-64bc-4161-b521-21ba19a64e20 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:50.320809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 137/273] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:49 2022] GET /identity/v3/role_assignments?user.id=419fc8740cf541e485ac303fcc2ab992&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:50.473300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947a670-c3eb-4ea0-821d-0bf4966d33ef None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:50.539820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:50.622405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947a670-c3eb-4ea0-821d-0bf4966d33ef None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:50.663643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35a2c6-9cf9-4e35-a495-56aea1ca671a None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.664283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35a2c6-9cf9-4e35-a495-56aea1ca671a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.664283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35a2c6-9cf9-4e35-a495-56aea1ca671a None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.665804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 138/274] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:50.671315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbb57-e45c-47e5-bb50-cb9fe13e3169 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.671692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbb57-e45c-47e5-bb50-cb9fe13e3169 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.671971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbb57-e45c-47e5-bb50-cb9fe13e3169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.672535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:50.673187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.673469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.673738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.692288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:50.693874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-eb6bbb57-e45c-47e5-bb50-cb9fe13e3169 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:50.695079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eb6bbb57-e45c-47e5-bb50-cb9fe13e3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:50.697443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:50.700087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:50.702035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 137/275] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:50.707405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:50.781770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 139/276] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:50.782999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbb57-e45c-47e5-bb50-cb9fe13e3169 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:50.801958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:50.836458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16101b0-b1d7-452b-b54e-a2b19bb722a0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:50.839058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:50.889078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:50.890325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.890821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.891527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.893601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:50.895931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:50.898331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 138/277] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:50.905168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:50.905748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bbb57-e45c-47e5-bb50-cb9fe13e3169 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:50.950416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:50.951439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:50.951920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:50.952391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:50.953292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:50.953928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:50.955534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:50.966320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 140/278] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:50.971648 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.020589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4fa5d-8c23-4d6b-937e-8c1e21c7d71d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.063614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:51.065630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.066339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.066810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.067170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.068032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:51.069660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:51.096012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 139/279] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:14:50 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:51.096999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.097325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d8f6-5571-4272-8dd2-ff204b2dd9ad None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.130394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:51.144670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131419-2d2d-42db-a230-0127d84de906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.145624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131419-2d2d-42db-a230-0127d84de906 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.146177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131419-2d2d-42db-a230-0127d84de906 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.147771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131419-2d2d-42db-a230-0127d84de906 None admin] PATH_INFO: `/v3/users/db043106722743498eec20babe1be031` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.169218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131419-2d2d-42db-a230-0127d84de906 None admin] RBAC: Authorizing `identity:get_user(user_id=db043106722743498eec20babe1be031)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:51.170908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131419-2d2d-42db-a230-0127d84de906 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:51.172721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 141/280] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:50 2022] GET /identity/v3/users/db043106722743498eec20babe1be031 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:51.173975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104f773-5e33-4dd1-b8ad-62ec1d8f0888 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.174291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104f773-5e33-4dd1-b8ad-62ec1d8f0888 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.174568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104f773-5e33-4dd1-b8ad-62ec1d8f0888 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.175961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 142/281] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:51.179561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104f773-5e33-4dd1-b8ad-62ec1d8f0888 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.221447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e1600-873e-4f39-839d-a58c6cc724ef None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.261105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5b95e-74c3-454e-9189-b25808154ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.262444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b95e-74c3-454e-9189-b25808154ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.262718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b95e-74c3-454e-9189-b25808154ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.262989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5b95e-74c3-454e-9189-b25808154ad7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.275201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5b95e-74c3-454e-9189-b25808154ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d0b5b95e-74c3-454e-9189-b25808154ad7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:51.280730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:51.281628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:51.282480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 140/282] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:51.283140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484944-8c48-4286-96d9-cebb61a6f287 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.283755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484944-8c48-4286-96d9-cebb61a6f287 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.283755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484944-8c48-4286-96d9-cebb61a6f287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.303054 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104f773-5e33-4dd1-b8ad-62ec1d8f0888 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.305363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-20484944-8c48-4286-96d9-cebb61a6f287 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:51.305644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-20484944-8c48-4286-96d9-cebb61a6f287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:51.338305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:51.343217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.343907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.344273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.344566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.345279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, user.id=db043106722743498eec20babe1be031, scope.system=all) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:51.345589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:51.347104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:51.353977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 143/283] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 30 19:14:51 2022] GET /identity/v3/role_assignments?user.id=db043106722743498eec20babe1be031&scope.system=all&role.id=101229ee973c472f99780a668e4c403f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:51.354904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.397677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 141/284] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:51.499664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f305a88-536d-46ce-abe3-02bec6bf1ba7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.544383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.545013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.545286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.545553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.546256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:51.546558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:51.547984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:51.557699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 144/285] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:51.564063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20484944-8c48-4286-96d9-cebb61a6f287 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.588168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:51.678168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20484944-8c48-4286-96d9-cebb61a6f287 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.703267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.722851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.723497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.723780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.724056 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] PATH_INFO: `/v3/users/f9913b544a2b43449d3a6e56d62fed71` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.725192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] RBAC: Authorizing `identity:get_user(user_id=f9913b544a2b43449d3a6e56d62fed71)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:51.726690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:51.728434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 142/286] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:51 2022] GET /identity/v3/users/f9913b544a2b43449d3a6e56d62fed71 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:51.737948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.780945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:51.844236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3db706-69e5-422f-a3e8-2bba470a15b1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.879438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3446-5688-4197-87b5-0cf006b6212d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:51.902863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:51.916483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.917393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.917946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.918460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.919916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:51.921582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:51.923827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 143/287] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:51 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:51.929437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:51.949097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:51.950734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:51.951228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:51.951693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:51.975314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:51.980788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:51.981821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:51.982682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:51.996290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 145/288] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:14:51.997243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:52.161865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154b7ef-d015-4f68-b259-fcb7a6c3852c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:52.169105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67088e79-8edf-4496-80ed-ed8afd3eae2b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:52.209677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:52.231920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:52.232586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:52.232864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:52.233133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49/users/f9913b544a2b43449d3a6e56d62fed71/roles/92836588d6be40ee895e245779951b32` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:52.238198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ea3421608452eae39510625fcfc49, user_id=f9913b544a2b43449d3a6e56d62fed71, role_id=92836588d6be40ee895e245779951b32)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:52.239647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:52.242299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:52.242913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:52.243192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:52.243465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:52.244129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:52.244436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:52.245981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:52.262194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 146/289] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:52.271792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 144/290] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:14:51 2022] PUT /identity/v3/projects/3e2ea3421608452eae39510625fcfc49/users/f9913b544a2b43449d3a6e56d62fed71/roles/92836588d6be40ee895e245779951b32 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:52.273395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:52.421106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37822d45-e308-4bc5-bc35-12ba65edd2e0 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:52.463202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:52.464198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:52.464959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:52.465506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] PATH_INFO: `/v3/users/436e5fb23df543b0a02937c0d4c34578` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:52.467121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] RBAC: Authorizing `identity:get_user(user_id=436e5fb23df543b0a02937c0d4c34578)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:52.468825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:52.470730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 147/291] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:52 2022] GET /identity/v3/users/436e5fb23df543b0a02937c0d4c34578 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:52.476905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:52.493626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:52.592722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729b2a0-387d-4dae-8c19-a79c8c74effe None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:52.637049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3378-5581-4441-899f-11aec693f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:52.638024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3378-5581-4441-899f-11aec693f601 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:52.638533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3378-5581-4441-899f-11aec693f601 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:52.639008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3378-5581-4441-899f-11aec693f601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:52.709466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db3378-5581-4441-899f-11aec693f601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:52.711383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db3378-5581-4441-899f-11aec693f601 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:52.730486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:52.819304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 145/292] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:14:52.821582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:52.889130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:52.961075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46272aa-1672-48a1-b2f4-1cdd1f1b6823 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:53.000640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76b96a-c2b3-4cd8-9d79-403d80eb1afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:53.001270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b96a-c2b3-4cd8-9d79-403d80eb1afb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:53.001556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b96a-c2b3-4cd8-9d79-403d80eb1afb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:53.001832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76b96a-c2b3-4cd8-9d79-403d80eb1afb None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:53.003008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76b96a-c2b3-4cd8-9d79-403d80eb1afb None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:53.004469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76b96a-c2b3-4cd8-9d79-403d80eb1afb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:53.010179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 148/293] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:52 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:53.013392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3378-5581-4441-899f-11aec693f601 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:53.116310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3378-5581-4441-899f-11aec693f601 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:53.134401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:53.152245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4577f7-7e80-4d6d-b18d-7e286356fde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:53.152870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4577f7-7e80-4d6d-b18d-7e286356fde7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:53.153644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4577f7-7e80-4d6d-b18d-7e286356fde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:53.153924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4577f7-7e80-4d6d-b18d-7e286356fde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:53.154688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4577f7-7e80-4d6d-b18d-7e286356fde7 None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=436e5fb23df543b0a02937c0d4c34578) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:53.155000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4577f7-7e80-4d6d-b18d-7e286356fde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:53.156549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4577f7-7e80-4d6d-b18d-7e286356fde7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:53.162739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 146/294] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:53 2022] GET /identity/v3/role_assignments?user.id=436e5fb23df543b0a02937c0d4c34578&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=101229ee973c472f99780a668e4c403f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:53.910377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadb27-f4e5-4342-aabf-aa52f7e248f1 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:53.910917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadb27-f4e5-4342-aabf-aa52f7e248f1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:53.911002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfadb27-f4e5-4342-aabf-aa52f7e248f1 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:53.912589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 149/295] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:53.918396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2208-6fe4-4480-ac5d-b8a36f248ce7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:53.918841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2208-6fe4-4480-ac5d-b8a36f248ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:53.918937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b2208-6fe4-4480-ac5d-b8a36f248ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:53.919195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be109cf8-8298-4388-8577-5e1c56513e71 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:53.919682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be109cf8-8298-4388-8577-5e1c56513e71 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:53.920139 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be109cf8-8298-4388-8577-5e1c56513e71 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:53.921644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 150/296] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:53.926823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bc1e5-76f4-460e-b09c-94da946c3787 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:53.927333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bc1e5-76f4-460e-b09c-94da946c3787 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:53.927798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bc1e5-76f4-460e-b09c-94da946c3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:53.939353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-074b2208-6fe4-4480-ac5d-b8a36f248ce7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:53.940624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-074b2208-6fe4-4480-ac5d-b8a36f248ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:53.947158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f80bc1e5-76f4-460e-b09c-94da946c3787 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:53.948600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f80bc1e5-76f4-460e-b09c-94da946c3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:54.033071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 147/297] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:54.039282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 151/298] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:54.141980 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e23a-127b-4780-a046-231f0a2d2cc7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.142680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e23a-127b-4780-a046-231f0a2d2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.143148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e23a-127b-4780-a046-231f0a2d2cc7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.144972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 148/299] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:54.150430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73360a-f42c-42f4-97be-0fdbdda51b21 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.150925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73360a-f42c-42f4-97be-0fdbdda51b21 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.151412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73360a-f42c-42f4-97be-0fdbdda51b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.169963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-af73360a-f42c-42f4-97be-0fdbdda51b21 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:54.171450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-af73360a-f42c-42f4-97be-0fdbdda51b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:54.215971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:54.241836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 152/300] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:54.308741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e23a-127b-4780-a046-231f0a2d2cc7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.339027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73360a-f42c-42f4-97be-0fdbdda51b21 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.423995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e23a-127b-4780-a046-231f0a2d2cc7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:54.434253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:54.467958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:54.468740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.469294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.469889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.473604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73360a-f42c-42f4-97be-0fdbdda51b21 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:54.481940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:54.487076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:54.487952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:54.488767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:54.491512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 149/301] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:54.496828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.517634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:54.518327 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.518603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.519153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.529668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:54.535368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:54.536288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:54.537087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 153/302] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:54.541920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.589740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:54.617303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00f3e5-9ff5-4e93-9805-b04186e8b078 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:54.657094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e5c51-d82f-4049-9710-8a27c3f0371a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:54.657313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:54.657799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.658108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.658377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.659045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:54.659351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:54.660725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:54.674252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 150/303] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:54.674252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.700774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:54.701618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.702037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.702172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:54.702564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.703435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:54.703930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:54.705787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:54.716498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 154/304] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:54.723107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.786488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56a9e-7a0b-43fc-97c8-391fe0480829 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:54.824151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:54.826110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:54.826673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.826933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.827224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.828322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:54.829317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044bdb8-661a-4ad1-a77f-f36239cf8133 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:54.829892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:54.831987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 151/305] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:54.832811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.863857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf26c-910a-4da9-86a6-cbc00a13c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:54.864486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf26c-910a-4da9-86a6-cbc00a13c64d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.864764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf26c-910a-4da9-86a6-cbc00a13c64d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.865035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf26c-910a-4da9-86a6-cbc00a13c64d None admin] PATH_INFO: `/v3/users/2ae2d3ee30184df39ef6acc191534056` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.878367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddf26c-910a-4da9-86a6-cbc00a13c64d None admin] RBAC: Authorizing `identity:get_user(user_id=2ae2d3ee30184df39ef6acc191534056)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:54.879840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddf26c-910a-4da9-86a6-cbc00a13c64d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:54.881738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 155/306] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/users/2ae2d3ee30184df39ef6acc191534056 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:54.882922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11983-144e-4d1e-ae4f-b02f22949f72 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.883207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11983-144e-4d1e-ae4f-b02f22949f72 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.883481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb11983-144e-4d1e-ae4f-b02f22949f72 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.884683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 156/307] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:54.885646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11983-144e-4d1e-ae4f-b02f22949f72 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.930820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:54.937784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ce4c4-4788-412f-9c10-a0d09831db18 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:54.971000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:54.971625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:54.971903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:54.972180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] PATH_INFO: `/v3/users/db043106722743498eec20babe1be031` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:54.973293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] RBAC: Authorizing `identity:get_user(user_id=db043106722743498eec20babe1be031)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:54.974776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:54.976500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 152/308] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/users/db043106722743498eec20babe1be031 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:54.977102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:54.994495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb11983-144e-4d1e-ae4f-b02f22949f72 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:55.032491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55119406-81d6-48e8-a1fb-fa8927c73883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:55.033096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55119406-81d6-48e8-a1fb-fa8927c73883 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:55.033376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55119406-81d6-48e8-a1fb-fa8927c73883 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:55.033648 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55119406-81d6-48e8-a1fb-fa8927c73883 None admin] PATH_INFO: `/v3/groups` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:55.034330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55119406-81d6-48e8-a1fb-fa8927c73883 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:55.035764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55119406-81d6-48e8-a1fb-fa8927c73883 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:55.050954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 157/309] 10.222.0.18 () {60 vars in 1134 bytes} [Fri Sep 30 19:14:54 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:14:55.059035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c0d5-edb6-4503-aec3-38af8e3503e3 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:55.059653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c0d5-edb6-4503-aec3-38af8e3503e3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:55.060166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c0d5-edb6-4503-aec3-38af8e3503e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:55.090721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b312c0d5-edb6-4503-aec3-38af8e3503e3 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:55.092362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b312c0d5-edb6-4503-aec3-38af8e3503e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:55.092908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce12a9-79d9-4947-bc2a-a8f4b942a907 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:55.109550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:55.134307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:55.134934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:55.135238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:55.135486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:55.136868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] RBAC: Adding query filter params (role.id=92836588d6be40ee895e245779951b32, user.id=2ae2d3ee30184df39ef6acc191534056, scope.system=all) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:55.137272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:55.138730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:55.144776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 153/310] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 30 19:14:54 2022] GET /identity/v3/role_assignments?user.id=2ae2d3ee30184df39ef6acc191534056&scope.system=all&role.id=92836588d6be40ee895e245779951b32 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:55.145438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:55.181780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:55.205449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 158/311] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:55.273404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc427c2-77de-42d5-a1e8-7625de32a27c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:55.311687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:55.312418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:55.312707 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:55.312982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] PATH_INFO: `/v3/system/users/db043106722743498eec20babe1be031/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:55.314491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db043106722743498eec20babe1be031, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:55.315893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:55.327876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 154/312] 10.222.0.18 () {58 vars in 1334 bytes} [Fri Sep 30 19:14:55 2022] PUT /identity/v3/system/users/db043106722743498eec20babe1be031/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:14:55.481040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c0d5-edb6-4503-aec3-38af8e3503e3 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:55.588760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c0d5-edb6-4503-aec3-38af8e3503e3 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:55.625064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:55.625711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:55.625992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:55.626295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:55.637497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:55.642405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:55.643312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:55.644120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 159/313] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:55.650749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:55.749346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:55.758242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841afbb1-d910-4b16-9688-4ef13464ca52 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:55.794361 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:55.795176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:55.795792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:55.796069 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:55.796742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:55.797051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:55.798461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:55.807409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 155/314] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:55.813243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:55.822877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:55.924391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd2cfc-e642-4064-9e0b-423aea33e68f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:55.959714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:55.960343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:55.960620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:55.960893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] PATH_INFO: `/v3/users/f9913b544a2b43449d3a6e56d62fed71` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:55.962023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] RBAC: Authorizing `identity:get_user(user_id=f9913b544a2b43449d3a6e56d62fed71)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:55.963556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:55.965626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 160/315] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:55 2022] GET /identity/v3/users/f9913b544a2b43449d3a6e56d62fed71 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:55.971111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:56.086201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a0c06-53b7-4e1a-a74d-aaed3da61409 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:56.121553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:56.122230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:56.122592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:56.122857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:56.147636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:56.191384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:56.192829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:56.297562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 156/316] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:14:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:14:56.299957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:56.377586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:56.407787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5e51b-c00e-45d5-84b1-ab6fce927d64 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:56.444443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862309b0-c91f-499a-93b3-a40f404e2ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:56.445426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862309b0-c91f-499a-93b3-a40f404e2ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:56.445930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862309b0-c91f-499a-93b3-a40f404e2ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:56.446424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862309b0-c91f-499a-93b3-a40f404e2ea6 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:56.447734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862309b0-c91f-499a-93b3-a40f404e2ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:56.450041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862309b0-c91f-499a-93b3-a40f404e2ea6 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:56.452274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 161/317] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:14:56 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:56.458626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:56.514969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:56.560952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558564f-3fd1-45ef-b369-2324ddcd6de9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:56.595089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833973-172d-4df8-ab89-cf2f84766048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:56.595688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833973-172d-4df8-ab89-cf2f84766048 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:56.595964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833973-172d-4df8-ab89-cf2f84766048 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:56.596232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833973-172d-4df8-ab89-cf2f84766048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:56.596948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833973-172d-4df8-ab89-cf2f84766048 None admin] RBAC: Adding query filter params (role.id=92836588d6be40ee895e245779951b32, scope.project.id=3e2ea3421608452eae39510625fcfc49, user.id=f9913b544a2b43449d3a6e56d62fed71) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:56.597252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833973-172d-4df8-ab89-cf2f84766048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:56.598708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833973-172d-4df8-ab89-cf2f84766048 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:56.605321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 157/318] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:14:56 2022] GET /identity/v3/role_assignments?user.id=f9913b544a2b43449d3a6e56d62fed71&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=92836588d6be40ee895e245779951b32 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:57.378219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264b5b7-981e-49ef-831b-c373805b14d6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.378713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264b5b7-981e-49ef-831b-c373805b14d6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.378713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264b5b7-981e-49ef-831b-c373805b14d6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.380077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 162/319] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:57.385448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a857-ff79-4a05-8843-d4cd943f4627 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.385830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a857-ff79-4a05-8843-d4cd943f4627 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.386771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5a857-ff79-4a05-8843-d4cd943f4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.403014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080884f-2a73-42cc-9a15-8a1eb7ae97f0 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.403296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080884f-2a73-42cc-9a15-8a1eb7ae97f0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.403758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080884f-2a73-42cc-9a15-8a1eb7ae97f0 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.405237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 163/320] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:14:57.405691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-46a5a857-ff79-4a05-8843-d4cd943f4627 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:57.406961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-46a5a857-ff79-4a05-8843-d4cd943f4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:57.410353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94cb30-2c86-4e86-922f-450c1b569b50 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.410634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94cb30-2c86-4e86-922f-450c1b569b50 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.410907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94cb30-2c86-4e86-922f-450c1b569b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.428415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ec94cb30-2c86-4e86-922f-450c1b569b50 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:57.429582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ec94cb30-2c86-4e86-922f-450c1b569b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:57.493027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 158/321] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:57.506182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 164/322] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:14:57.562154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f73f-1609-4646-9cd0-21645929b7fe None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.562438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f73f-1609-4646-9cd0-21645929b7fe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.562725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9f73f-1609-4646-9cd0-21645929b7fe None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.564199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 159/323] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:14:57.569146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e609a5-b9de-420c-aa21-43aab8bdea74 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.569438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e609a5-b9de-420c-aa21-43aab8bdea74 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.569716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e609a5-b9de-420c-aa21-43aab8bdea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.588593 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-97e609a5-b9de-420c-aa21-43aab8bdea74 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:14:57.590083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-97e609a5-b9de-420c-aa21-43aab8bdea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:14:57.659169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 165/324] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:14:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:14:57.762121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f73f-1609-4646-9cd0-21645929b7fe None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:57.775430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e609a5-b9de-420c-aa21-43aab8bdea74 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:57.778771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:57.816322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:57.871723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9f73f-1609-4646-9cd0-21645929b7fe None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:57.882537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e609a5-b9de-420c-aa21-43aab8bdea74 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:57.908397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:57.909369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.909650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.909915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.920725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:57.921351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:57.921454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:57.921631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:57.921901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:57.923016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:57.924460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:57.926309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 166/325] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:14:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:57.926414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:57.932608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:14:57.933467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:14:57.934122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:57.934194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 160/326] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:57.934194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:58.000644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:58.031565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723394-4d04-40df-a644-1f6d619b76f4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.031795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6a0d4-8c53-4f13-967f-eea5ed1bbca3 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.041252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:58.067520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.068145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.068419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.068685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.069936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.070568 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.070846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.071116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] PATH_INFO: `/v3/groups` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.071738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:58.073189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:58.079297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:14:58.084948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:14:58.086038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 167/327] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:14:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:14:58.086992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:58.093662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 161/328] 10.222.0.18 () {60 vars in 1134 bytes} [Fri Sep 30 19:14:57 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:14:58.094592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:58.208775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6305c-1b63-4b71-8054-058c36359317 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.212786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf19346-035c-4b8b-955c-193b1e8c68a3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.243481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:58.252624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.253728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.254187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.254636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.255658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:58.256479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:58.256592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.257192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.257469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.257743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.258447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:58.258749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:58.258908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:58.260108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:58.269303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 162/329] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:58.270215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 168/330] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:14:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:58.275253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:58.275983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:58.314043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:58.396817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd689-85a2-4cd4-a5fa-cff3b5a2a3c3 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.415596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6191a-6a1d-48a7-bba1-5ba7426d870b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.441799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.442615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.442898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.443781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] PATH_INFO: `/v3/users/2ae2d3ee30184df39ef6acc191534056` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.444953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae2d3ee30184df39ef6acc191534056)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:58.446625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:58.448976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 169/331] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:58 2022] GET /identity/v3/users/2ae2d3ee30184df39ef6acc191534056 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:58.454569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:58.456690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.457335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.457613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.457882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] PATH_INFO: `/v3/users/db043106722743498eec20babe1be031` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.459101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] RBAC: Authorizing `identity:get_user(user_id=db043106722743498eec20babe1be031)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:58.460511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:58.462663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 163/332] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:14:58 2022] GET /identity/v3/users/db043106722743498eec20babe1be031 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:14:58.469740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:14:58.528884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:58.584253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027d95b-677d-445e-af2a-001682a60d62 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.599498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:14:58.606288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a710b-9cb5-4258-b066-227ac58c3cdf None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:14:58.643856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131e0cb-6c1a-4b99-aebb-7bc87fc00413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.644826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131e0cb-6c1a-4b99-aebb-7bc87fc00413 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.645182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131e0cb-6c1a-4b99-aebb-7bc87fc00413 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.645526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131e0cb-6c1a-4b99-aebb-7bc87fc00413 None admin] PATH_INFO: `/v3/system/users/2ae2d3ee30184df39ef6acc191534056/roles/92836588d6be40ee895e245779951b32` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.647213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131e0cb-6c1a-4b99-aebb-7bc87fc00413 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ae2d3ee30184df39ef6acc191534056, role_id=92836588d6be40ee895e245779951b32)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:58.648720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131e0cb-6c1a-4b99-aebb-7bc87fc00413 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:58.653999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957deccc-3ee7-4478-a10f-b0c5a470dfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:14:58.654668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957deccc-3ee7-4478-a10f-b0c5a470dfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:14:58.655073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957deccc-3ee7-4478-a10f-b0c5a470dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:14:58.655429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957deccc-3ee7-4478-a10f-b0c5a470dfd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:14:58.656585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957deccc-3ee7-4478-a10f-b0c5a470dfd7 None admin] RBAC: Adding query filter params (role.id=101229ee973c472f99780a668e4c403f, user.id=db043106722743498eec20babe1be031, scope.system=all) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:14:58.656978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957deccc-3ee7-4478-a10f-b0c5a470dfd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:14:58.658527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957deccc-3ee7-4478-a10f-b0c5a470dfd7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:14:58.665100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 170/333] 10.222.0.18 () {58 vars in 1334 bytes} [Fri Sep 30 19:14:58 2022] PUT /identity/v3/system/users/2ae2d3ee30184df39ef6acc191534056/roles/92836588d6be40ee895e245779951b32 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:14:58.674465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 164/334] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 30 19:14:58 2022] GET /identity/v3/role_assignments?user.id=db043106722743498eec20babe1be031&scope.system=all&role.id=101229ee973c472f99780a668e4c403f => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:00.613741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582b4d5-1956-42dc-9c4b-95befa5b7b9a None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:00.614573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582b4d5-1956-42dc-9c4b-95befa5b7b9a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:00.614573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582b4d5-1956-42dc-9c4b-95befa5b7b9a None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:00.615922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 171/335] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:00.622206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c7c84-eb19-4993-8d3c-5929c53addb1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:00.622719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c7c84-eb19-4993-8d3c-5929c53addb1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:00.623218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c7c84-eb19-4993-8d3c-5929c53addb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:00.647907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5e3c7c84-eb19-4993-8d3c-5929c53addb1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:00.649141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5e3c7c84-eb19-4993-8d3c-5929c53addb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:00.732670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 165/336] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:00.735370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ca228-80ca-4eca-bbf4-31146c30f7bd None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:00.735663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ca228-80ca-4eca-bbf4-31146c30f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:00.735940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ca228-80ca-4eca-bbf4-31146c30f7bd None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:00.738425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 172/337] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:00.742723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0bef-5789-499c-acbd-ef9005a8cf7b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:00.743015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0bef-5789-499c-acbd-ef9005a8cf7b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:00.743292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e0bef-5789-499c-acbd-ef9005a8cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:00.766866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ac3e0bef-5789-499c-acbd-ef9005a8cf7b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:00.768054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ac3e0bef-5789-499c-acbd-ef9005a8cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:00.857268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 166/338] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:01.233439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ca228-80ca-4eca-bbf4-31146c30f7bd None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:01.267943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0bef-5789-499c-acbd-ef9005a8cf7b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:01.307608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:01.431864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ca228-80ca-4eca-bbf4-31146c30f7bd None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:01.476678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e0bef-5789-499c-acbd-ef9005a8cf7b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:01.477647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:01.499733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815681d-21b9-4e8b-ae26-6d7134189f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:01.500384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815681d-21b9-4e8b-ae26-6d7134189f52 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:01.500662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815681d-21b9-4e8b-ae26-6d7134189f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:01.500938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815681d-21b9-4e8b-ae26-6d7134189f52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:01.522939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815681d-21b9-4e8b-ae26-6d7134189f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-9815681d-21b9-4e8b-ae26-6d7134189f52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:01.528001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:01.528929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:01.529737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 173/339] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:01.530706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ca21e-2fb5-4d41-ae5a-9a22763e5db5 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:01.531134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ca21e-2fb5-4d41-ae5a-9a22763e5db5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:01.531550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ca21e-2fb5-4d41-ae5a-9a22763e5db5 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:01.535464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 174/340] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:01.539449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ca21e-2fb5-4d41-ae5a-9a22763e5db5 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:01.539694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf9c55-897c-4b4d-b955-75c75a214edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:01.540455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9c55-897c-4b4d-b955-75c75a214edf None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:01.540742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9c55-897c-4b4d-b955-75c75a214edf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:01.541014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf9c55-897c-4b4d-b955-75c75a214edf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:01.568015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf9c55-897c-4b4d-b955-75c75a214edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-62bf9c55-897c-4b4d-b955-75c75a214edf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:01.573001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:01.574696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:01.575532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:01.578147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 167/341] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:15:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:01.586634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7711d4-9027-404f-b5d5-6cc833099d50 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:01.587036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7711d4-9027-404f-b5d5-6cc833099d50 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:01.587260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7711d4-9027-404f-b5d5-6cc833099d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:01.630203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ab7711d4-9027-404f-b5d5-6cc833099d50 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:01.631683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab7711d4-9027-404f-b5d5-6cc833099d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:01.718912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 168/342] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:01.719693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7711d4-9027-404f-b5d5-6cc833099d50 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:01.741293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:01.754611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ca21e-2fb5-4d41-ae5a-9a22763e5db5 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:01.808175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:01.808782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:01.809159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:01.809359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:01.809952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:01.810274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:01.811654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:01.834497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 175/343] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:15:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:01.838950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:01.913530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:01.953574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7711d4-9027-404f-b5d5-6cc833099d50 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:01.978567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0590-fd28-4203-8042-0b409f41b692 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:02.020509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd210d54-9a18-43f0-b82d-a071245cdc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:02.021117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd210d54-9a18-43f0-b82d-a071245cdc0b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.021393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd210d54-9a18-43f0-b82d-a071245cdc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.021663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd210d54-9a18-43f0-b82d-a071245cdc0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.028183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:02.028812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.029095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.029371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.030068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:02.030541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:02.031934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:02.052374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 169/344] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:02.067302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:02.098177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd210d54-9a18-43f0-b82d-a071245cdc0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:02.099650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd210d54-9a18-43f0-b82d-a071245cdc0b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:02.163549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:02.168761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:02.206667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22783d6-853c-4638-a2a4-d263fa1c76d2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:02.256274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83064c2-e5d9-4c32-8752-42971b1a67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:02.257226 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83064c2-e5d9-4c32-8752-42971b1a67e8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.257923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83064c2-e5d9-4c32-8752-42971b1a67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.259094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83064c2-e5d9-4c32-8752-42971b1a67e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.293650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 176/345] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:02.296532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff159-ac78-4eab-bcab-67106049244b None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.297190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff159-ac78-4eab-bcab-67106049244b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.298964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff159-ac78-4eab-bcab-67106049244b None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.300479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 177/346] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:02.301609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff159-ac78-4eab-bcab-67106049244b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:02.360684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83064c2-e5d9-4c32-8752-42971b1a67e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:02.362160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83064c2-e5d9-4c32-8752-42971b1a67e8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:02.435297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:02.437645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff159-ac78-4eab-bcab-67106049244b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:02.480910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:02.485868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 170/347] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:02.485868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993f02f-4281-46ea-b42c-56c709f73ae6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.485868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993f02f-4281-46ea-b42c-56c709f73ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.485868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993f02f-4281-46ea-b42c-56c709f73ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.486427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.486942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.486942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.488381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:02.489845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:02.491766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 178/348] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:02 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:02.492582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:02.508187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5993f02f-4281-46ea-b42c-56c709f73ae6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:02.509666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5993f02f-4281-46ea-b42c-56c709f73ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:02.516484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:02.610083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 171/349] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:02.610083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993f02f-4281-46ea-b42c-56c709f73ae6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:02.654473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3383b7-0d97-4559-94be-a34f6901c1ed None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:02.707562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:02.708197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.708473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.708744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.721611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:02.726782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:02.727741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:02.729271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 179/350] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:02.729971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:02.800109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:02.805869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993f02f-4281-46ea-b42c-56c709f73ae6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:02.825437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:02.872535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:02.874933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.875626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.877714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c007ed2-254e-41c2-83d5-99e82788d829 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:02.878233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.879710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:02.881594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:02.885900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 172/351] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:02 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:02.888283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:02.935329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:02.936223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:02.936725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:02.937160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:02.944091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:02.945908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:02.947760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 180/352] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:02 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:02.949225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.075079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7817d-a680-4a11-b0ce-5faad3cb173f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.093058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0b8f4-ab3a-4ac2-a54e-175393129a8b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.125140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.125769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.126067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.126365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.127141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:03.127453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:03.128957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:03.136056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.139020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.139020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.139020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.141559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:03.141705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 173/353] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:15:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:03.141818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.141904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:03.143722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 181/354] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:02 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:03.147009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.159079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:03.185160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:03.284163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b4282-1847-409e-ae3d-42d77dca8338 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.291162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbbcc1-a78a-4807-a089-d9d908613ed5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.327146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d79142-1201-4166-ba0f-8a54cf803d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.327673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79142-1201-4166-ba0f-8a54cf803d74 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.327949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79142-1201-4166-ba0f-8a54cf803d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.328217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79142-1201-4166-ba0f-8a54cf803d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.328938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79142-1201-4166-ba0f-8a54cf803d74 None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=101229ee973c472f99780a668e4c403f, scope.project.id=22e698822779475e97944863e83b7475) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:03.329243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79142-1201-4166-ba0f-8a54cf803d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:03.330778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d79142-1201-4166-ba0f-8a54cf803d74 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:03.335550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.336378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 174/355] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:03 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=22e698822779475e97944863e83b7475&role.id=101229ee973c472f99780a668e4c403f => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:03.337227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.337542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461d32-3b92-49e9-8ddf-a5ba3c023027 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.337701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.337804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461d32-3b92-49e9-8ddf-a5ba3c023027 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.338080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.338176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461d32-3b92-49e9-8ddf-a5ba3c023027 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.339670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 175/356] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:03.340193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461d32-3b92-49e9-8ddf-a5ba3c023027 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.351801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:03.357587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:03.358802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:03.359834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:03.360589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 182/357] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:03.361543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.454471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:03.483643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:03.497448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461d32-3b92-49e9-8ddf-a5ba3c023027 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.502859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e8edd-61e7-421d-a7c6-6bdc34563813 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.540648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298486df-6ab6-4e28-ad8d-db5e4be09a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.541311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298486df-6ab6-4e28-ad8d-db5e4be09a45 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.541915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298486df-6ab6-4e28-ad8d-db5e4be09a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.542288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298486df-6ab6-4e28-ad8d-db5e4be09a45 None admin] PATH_INFO: `/v3/users/2ae2d3ee30184df39ef6acc191534056` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.543456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298486df-6ab6-4e28-ad8d-db5e4be09a45 None admin] RBAC: Authorizing `identity:get_user(user_id=2ae2d3ee30184df39ef6acc191534056)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:03.544995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298486df-6ab6-4e28-ad8d-db5e4be09a45 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:03.546980 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 176/358] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:15:03 2022] GET /identity/v3/users/2ae2d3ee30184df39ef6acc191534056 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:03.548110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.548239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4bb19-40b3-489f-8658-f276b23403f1 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.548316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.548385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4bb19-40b3-489f-8658-f276b23403f1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.548620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.548792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4bb19-40b3-489f-8658-f276b23403f1 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.548866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.549486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=22e698822779475e97944863e83b7475) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:03.550592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:03.550696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 177/359] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:03.551281 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:03.551461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52425f1-d3ac-43c8-b507-1db5ab68249b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.551728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52425f1-d3ac-43c8-b507-1db5ab68249b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.551992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52425f1-d3ac-43c8-b507-1db5ab68249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.563880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 183/360] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:03 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=22e698822779475e97944863e83b7475&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:03.564636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.573709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c52425f1-d3ac-43c8-b507-1db5ab68249b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:03.574304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c52425f1-d3ac-43c8-b507-1db5ab68249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:03.681446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 178/361] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:03.682920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52425f1-d3ac-43c8-b507-1db5ab68249b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.733621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd553-c364-4a0b-b472-c6d5ab8447ef None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.775511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:03.787103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995bc55d-d069-46aa-81ab-82416c4e7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.787722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc55d-d069-46aa-81ab-82416c4e7401 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.788001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc55d-d069-46aa-81ab-82416c4e7401 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.788272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bc55d-d069-46aa-81ab-82416c4e7401 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.788936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bc55d-d069-46aa-81ab-82416c4e7401 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:03.789241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bc55d-d069-46aa-81ab-82416c4e7401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:03.790467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:03.790643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995bc55d-d069-46aa-81ab-82416c4e7401 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:03.801061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52425f1-d3ac-43c8-b507-1db5ab68249b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:03.805570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 184/362] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:15:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:03.806910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb78305-de28-44ed-a001-1440a5665d89 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.807118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb78305-de28-44ed-a001-1440a5665d89 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.807957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb78305-de28-44ed-a001-1440a5665d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.829801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-edb78305-de28-44ed-a001-1440a5665d89 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:03.834892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-edb78305-de28-44ed-a001-1440a5665d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:03.839938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:03.840555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:03.840831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:03.841106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:03.841836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] RBAC: Adding query filter params (role.id=92836588d6be40ee895e245779951b32, user.id=2ae2d3ee30184df39ef6acc191534056, scope.system=all) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:03.842171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:03.843611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:03.857162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 179/363] 10.222.0.18 () {56 vars in 1308 bytes} [Fri Sep 30 19:15:03 2022] GET /identity/v3/role_assignments?user.id=2ae2d3ee30184df39ef6acc191534056&scope.system=all&role.id=92836588d6be40ee895e245779951b32 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:03.858362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:03.944634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 185/364] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:03.981881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1717e-6a7a-46a9-b271-bd011dac3260 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:04.051948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:04.054806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:04.054806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:04.054806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:04.081767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:04.158319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:04.159763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:04.274499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb78305-de28-44ed-a001-1440a5665d89 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.284460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 180/365] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:04.295259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.349189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:04.408849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed8d6-5c39-4b85-8a73-77f82ac61a6d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:04.459354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:04.460014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:04.460298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:04.460572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:04.462082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:04.465515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:04.467534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 181/366] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:04.468411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.492395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb78305-de28-44ed-a001-1440a5665d89 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:04.522880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:04.536199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:04.536846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:04.537192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:04.537529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:04.552040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:04.557661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:04.559096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:04.559933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:04.562252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 186/367] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:04.566006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.587204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d1082-7996-4883-9001-9ea32fae9c2f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:04.608903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:04.642021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:04.643239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:04.643549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:04.644476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:04.661733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:04.669352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:04.670921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 182/368] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:04.672654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.692118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9624b2-b434-4857-a870-46806f26e33e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:04.740453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:04.741103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:04.741428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:04.742149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:04.744179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:04.746517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:04.749050 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 187/369] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:04.750217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.812932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef4be-32b4-4174-88cf-c31cec1db02f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:04.814751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:04.848005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:04.848613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:04.848887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:04.849154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:04.849866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:04.850206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:04.851609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:04.861025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 183/370] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:04.861940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.871588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33c373-5310-4af4-be40-05b1cc81970e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:04.903679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:04.912672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:04.913388 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:04.913674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:04.913951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:04.914669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:04.914975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:04.917207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:04.926836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 188/371] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:04.927630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:04.969333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ce92d-0569-408d-ae7b-3eb6de80a18a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.007056 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.007625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.007901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.008169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.008942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=101229ee973c472f99780a668e4c403f, scope.project.id=3e2ea3421608452eae39510625fcfc49) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:05.009293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.011588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.017907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 184/372] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=101229ee973c472f99780a668e4c403f => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:05.018878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:05.040783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0531c-37dc-4e87-9a5a-1fa148ff73de None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.070606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:05.088419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.089402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.089844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.091394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.135946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30167f-13dd-4ef6-a23c-f1a275e96269 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.137852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:05.192579 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.193506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.196024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.196024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.196024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.197042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.293169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.294932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.314249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 189/373] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:05.319869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:05.341631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:05.430540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 185/374] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:05.437957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:05.440346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:05.455581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2510c44-680c-4203-bf6e-1bd7f6493c92 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.494367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.494923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.495197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.495544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.496721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.498679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.500210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 190/375] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:05 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:05.505896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:05.549780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d8865-9c10-4b7c-ae4e-8be7a5f5cfe2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.591359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.592414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.592899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.593372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] PATH_INFO: `/v3/projects/6d3b383133b449569f26f949e441f7e5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.594760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=6d3b383133b449569f26f949e441f7e5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.596424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.598680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 186/376] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:05 2022] GET /identity/v3/projects/6d3b383133b449569f26f949e441f7e5 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:05.607104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:05.608258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:05.634253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101ec17-830f-41f8-b123-5d9fe98807c4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.672706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.673725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.674242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.674726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.676048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.677828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.681106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 191/377] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:05 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:05.685638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:05.704518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:05.740593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4982a36-22b1-4d2a-a7d0-16c5aa70d5d9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.790504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.792181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.792741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.793228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] PATH_INFO: `/v3/groups/32f16186784146658ed2a081b2439a1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.804932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] RBAC: Authorizing `identity:get_group(group_id=32f16186784146658ed2a081b2439a1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.809733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.811728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 187/378] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:05 2022] GET /identity/v3/groups/32f16186784146658ed2a081b2439a1d => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:05.817812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:05.829387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae824c7-2077-4fbd-88c9-34b904fd11ab None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:05.872252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc965-177e-45db-bd38-20b65c6791ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:05.872850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc965-177e-45db-bd38-20b65c6791ad None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:05.873270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc965-177e-45db-bd38-20b65c6791ad None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:05.873380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc965-177e-45db-bd38-20b65c6791ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:05.874159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc965-177e-45db-bd38-20b65c6791ad None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=3e2ea3421608452eae39510625fcfc49) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:05.874467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc965-177e-45db-bd38-20b65c6791ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:05.875913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc965-177e-45db-bd38-20b65c6791ad None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:05.882331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 192/379] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:05 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:05.967557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a53a2-df2e-461a-96e2-9619794c4cd0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:06.008890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158a73f-feb4-47ab-ac65-8571ad2a4a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:06.009560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a73f-feb4-47ab-ac65-8571ad2a4a1a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:06.009870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a73f-feb4-47ab-ac65-8571ad2a4a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:06.010185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158a73f-feb4-47ab-ac65-8571ad2a4a1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:06.011421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158a73f-feb4-47ab-ac65-8571ad2a4a1a None admin] RBAC: Adding query filter params (group.id=32f16186784146658ed2a081b2439a1d, role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=6d3b383133b449569f26f949e441f7e5) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:06.011764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158a73f-feb4-47ab-ac65-8571ad2a4a1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:06.013264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158a73f-feb4-47ab-ac65-8571ad2a4a1a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:06.015629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:06.020467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 188/380] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:05 2022] GET /identity/v3/role_assignments?group.id=32f16186784146658ed2a081b2439a1d&scope.project.id=6d3b383133b449569f26f949e441f7e5&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:06.339481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a435dc5-7fd9-41fc-be88-ea2b9fb6b16c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:06.339864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a435dc5-7fd9-41fc-be88-ea2b9fb6b16c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:06.340040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a435dc5-7fd9-41fc-be88-ea2b9fb6b16c None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:06.342195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 193/381] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:06.347719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085b6d-93ab-48a2-ba67-fffd21da3aa7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:06.348345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085b6d-93ab-48a2-ba67-fffd21da3aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:06.348850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed085b6d-93ab-48a2-ba67-fffd21da3aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:06.374028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ed085b6d-93ab-48a2-ba67-fffd21da3aa7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:06.375622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ed085b6d-93ab-48a2-ba67-fffd21da3aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:06.471562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c4c7-702a-4a57-b270-f0d2a5ffad46 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:06.472144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c4c7-702a-4a57-b270-f0d2a5ffad46 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:06.472607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5c4c7-702a-4a57-b270-f0d2a5ffad46 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:06.474194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 194/383] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:06.474414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 189/383] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:06.499437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba3c9-3e6e-4a36-8128-ac95babb1fa0 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:06.500032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba3c9-3e6e-4a36-8128-ac95babb1fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:06.500502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba3c9-3e6e-4a36-8128-ac95babb1fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:06.525605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-fb3ba3c9-3e6e-4a36-8128-ac95babb1fa0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:06.527875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fb3ba3c9-3e6e-4a36-8128-ac95babb1fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:06.536456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:06.619942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 195/384] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:06.790869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed085b6d-93ab-48a2-ba67-fffd21da3aa7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:06.922092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed085b6d-93ab-48a2-ba67-fffd21da3aa7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:06.927189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ba3c9-3e6e-4a36-8128-ac95babb1fa0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:06.962033 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:06.982511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:06.983616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:06.984111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:06.984582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.004016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:07.009570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:07.010557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:07.011417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:07.016651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 190/385] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:07.022402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:07.109636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ba3c9-3e6e-4a36-8128-ac95babb1fa0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.172606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:07.173192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:07.173472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:07.173744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.195723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:07.201549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:07.202490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:07.203307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:07.208791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 196/386] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:15:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:07.212062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:07.217381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:07.228269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c125a5-f5ad-4626-9c8d-63d333f811d4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.287186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:07.287812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:07.288092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:07.288355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.289028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:07.289329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:07.290772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:07.300762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 191/387] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:15:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:07.306278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:07.366464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:07.400260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0a875-379e-442c-b324-6d859b80fbc5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.436753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f503-9571-4d20-b30d-c8cc7b68683c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.470335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:07.470954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:07.471239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:07.471513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.472178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:07.472650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:07.474209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:07.481504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:07.482340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:07.482757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:07.483165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.484907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:07.486532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:07.488238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 192/388] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:07 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:07.492737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 197/389] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:07.493723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:07.498419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:07.600905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:07.677251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c1407-48ff-4ce6-a66f-8ea121f1bc3c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.701720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9fbb1-fa84-4b62-be5a-c79a52a32967 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.735135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:07.751313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:07.752023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:07.752305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:07.752578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.754244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:07.755944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:07.757682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 198/390] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:07 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:07.766088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:07.766734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:07.767016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:07.767290 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.768433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:07.769853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:07.772229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 193/391] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:07 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:07.773717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:07.778312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:07.947389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0de1e-3a68-41f9-9b00-22a1b50c9f1a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.966813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eccb4-5c2e-4ccc-a0c3-f6f02895dc9c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:07.981017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:07.987508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:07.988353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:07.988792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:07.989205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:07.990583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:07.992209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:07.998147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 199/392] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:07 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:08.000256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:08.026935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a9eab-89b8-4d37-ade5-68e8d8b2a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:08.027611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a9eab-89b8-4d37-ade5-68e8d8b2a9cb None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:08.027893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a9eab-89b8-4d37-ade5-68e8d8b2a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:08.028167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a9eab-89b8-4d37-ade5-68e8d8b2a9cb None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475/groups/871578975ba74ccca4540f667ebfd5b1/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:08.030127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a9eab-89b8-4d37-ade5-68e8d8b2a9cb None admin] RBAC: Authorizing `identity:create_grant(project_id=22e698822779475e97944863e83b7475, group_id=871578975ba74ccca4540f667ebfd5b1, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:08.031771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a9eab-89b8-4d37-ade5-68e8d8b2a9cb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:08.047068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 194/393] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 30 19:15:07 2022] PUT /identity/v3/projects/22e698822779475e97944863e83b7475/groups/871578975ba74ccca4540f667ebfd5b1/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:08.142171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976071-6bf6-47d2-947b-fc005cf60413 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:08.187314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61da09-29cf-4c51-b4a9-2bd45a40e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:08.188300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61da09-29cf-4c51-b4a9-2bd45a40e879 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:08.188807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61da09-29cf-4c51-b4a9-2bd45a40e879 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:08.189258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61da09-29cf-4c51-b4a9-2bd45a40e879 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475/groups/871578975ba74ccca4540f667ebfd5b1/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:08.192009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61da09-29cf-4c51-b4a9-2bd45a40e879 None admin] RBAC: Authorizing `identity:create_grant(project_id=22e698822779475e97944863e83b7475, group_id=871578975ba74ccca4540f667ebfd5b1, role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:08.193793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61da09-29cf-4c51-b4a9-2bd45a40e879 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:08.219883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 200/394] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 30 19:15:07 2022] PUT /identity/v3/projects/22e698822779475e97944863e83b7475/groups/871578975ba74ccca4540f667ebfd5b1/roles/e508ed31828645df8c584b7fbe1798e4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:15:08.412754 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fae83-4780-4786-9fca-8e553dfd0275 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:08.413430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fae83-4780-4786-9fca-8e553dfd0275 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:08.413934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fae83-4780-4786-9fca-8e553dfd0275 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:08.415835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 195/395] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:08.422323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aa1f1-e160-41ea-82bb-c1810e8c88e7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:08.422930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aa1f1-e160-41ea-82bb-c1810e8c88e7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:08.423402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aa1f1-e160-41ea-82bb-c1810e8c88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:08.446209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-511aa1f1-e160-41ea-82bb-c1810e8c88e7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:08.448059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-511aa1f1-e160-41ea-82bb-c1810e8c88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:08.511667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:08.524832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 201/396] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:08.897262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce791d-9086-4ef5-98c8-6245bd3a8f29 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:08.898021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce791d-9086-4ef5-98c8-6245bd3a8f29 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:08.898475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce791d-9086-4ef5-98c8-6245bd3a8f29 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:08.899769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aa1f1-e160-41ea-82bb-c1810e8c88e7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:08.900287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 196/397] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:08.905414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af598-726e-4b46-ba28-87ee76696e81 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:08.905987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af598-726e-4b46-ba28-87ee76696e81 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:08.906484 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af598-726e-4b46-ba28-87ee76696e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:08.934714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-667af598-726e-4b46-ba28-87ee76696e81 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:08.936268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-667af598-726e-4b46-ba28-87ee76696e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:09.015505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:09.033683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aa1f1-e160-41ea-82bb-c1810e8c88e7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:09.054876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 197/398] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:09.057725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f8f6-8ed5-4ec8-a816-ace0b53c4f7d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.058236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f8f6-8ed5-4ec8-a816-ace0b53c4f7d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.058735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f8f6-8ed5-4ec8-a816-ace0b53c4f7d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.060585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 198/399] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:09.078469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cb15-6fd5-4b49-b3f1-a7b262547ea1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.079392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cb15-6fd5-4b49-b3f1-a7b262547ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.080173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47cb15-6fd5-4b49-b3f1-a7b262547ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.083827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:09.084644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.085077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.085520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.100870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:09.108224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:09.109403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:09.110434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:09.113315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 202/400] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:09.120815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:09.122900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1b47cb15-6fd5-4b49-b3f1-a7b262547ea1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:09.124333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1b47cb15-6fd5-4b49-b3f1-a7b262547ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:09.207114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 199/401] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:09.227848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:09.311003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf6d39-cafa-4f1d-8d24-9654bf6511f7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:09.366039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:09.366685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.366968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.367243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.367924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:09.368326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:09.371105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:09.381284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 203/402] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:15:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:09.387585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47cb15-6fd5-4b49-b3f1-a7b262547ea1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:09.514109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47cb15-6fd5-4b49-b3f1-a7b262547ea1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:09.516928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:09.523598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:09.552841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:09.553470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.553745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.554021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.555174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:09.557457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:09.559651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 200/403] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:09 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:09.565249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:09.701358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889e15d-cbf3-40da-bde9-c3ad192f8e4f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:09.708289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43167-7f3a-4213-8918-97fe3b76ef41 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:09.718996 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:09.752066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:09.752717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.752997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.753274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.759266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:09.760907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.761405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.761861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.763287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:09.766461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:09.771419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:09.773221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 201/404] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:09 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:09.774333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:09.774535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:09.775723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:09.776550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:09.784785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 204/405] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:09.784785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:09.842279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:09.922965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624b77-e940-4d0c-a3db-10591006007f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:09.942183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f301f62-f402-479c-bed7-e8832597af1d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:09.968389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:09.969396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.969907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.970406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.982832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:09.988059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:09.989410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:09.990246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:09.990910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:09.990998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:09.991272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:09.991715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49/groups/871578975ba74ccca4540f667ebfd5b1/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:09.997453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 202/406] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:15:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:09.997453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:09.999434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ea3421608452eae39510625fcfc49, group_id=871578975ba74ccca4540f667ebfd5b1, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.002126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.022096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 205/407] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 30 19:15:09 2022] PUT /identity/v3/projects/3e2ea3421608452eae39510625fcfc49/groups/871578975ba74ccca4540f667ebfd5b1/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:10.023780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:10.093092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:10.192093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0c32-75dd-4757-aeba-9548b5d37ad6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.193883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:10.214985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db3ba-12c8-4d7a-b610-00f8160ead1d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.268541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.269154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.269426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.269694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.270699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:10.270699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.272048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.276276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.277138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.277618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.278190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.279174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:10.279689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.281313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.286167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 206/408] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:10.288013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:10.293579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 203/409] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:10.300182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:10.394430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:10.401349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899a9b6-f3f5-4120-89e5-90893b4a8265 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.442751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de58f-9472-4de8-a312-4198258a9744 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.443098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.443661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.443941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.444210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.445330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.447442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.452646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:10 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:10.454439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:10.487795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.489503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.490323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.490800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] PATH_INFO: `/v3/groups/32f16186784146658ed2a081b2439a1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.492280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] RBAC: Authorizing `identity:get_group(group_id=32f16186784146658ed2a081b2439a1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.494600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.497103 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 204/411] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:10 2022] GET /identity/v3/groups/32f16186784146658ed2a081b2439a1d => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:10.503196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:10.544692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:10.564934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fcc33-3e03-4ed0-a1c9-ce0ab0bd0c42 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.602283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.602915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.603192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.603622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.605138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.606410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.612083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 208/412] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:10 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:10.614302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:10.637158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861651-610a-4d6a-9aa1-936cd7dfc391 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.647922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:10.681467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.682589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.683099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.683565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] PATH_INFO: `/v3/projects/6d3b383133b449569f26f949e441f7e5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.684897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] RBAC: Authorizing `identity:get_project(project_id=6d3b383133b449569f26f949e441f7e5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.686718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.689158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 205/413] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:10 2022] GET /identity/v3/projects/6d3b383133b449569f26f949e441f7e5 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:10.694937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:10.792036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676ddc3-b06f-4c06-86a8-aff833827cc5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.832624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e599e7-4805-4120-9d15-d3bef27eb855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.833993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e599e7-4805-4120-9d15-d3bef27eb855 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.834544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e599e7-4805-4120-9d15-d3bef27eb855 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.835269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e599e7-4805-4120-9d15-d3bef27eb855 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49/groups/871578975ba74ccca4540f667ebfd5b1/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.838075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e599e7-4805-4120-9d15-d3bef27eb855 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ea3421608452eae39510625fcfc49, group_id=871578975ba74ccca4540f667ebfd5b1, role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.840753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e599e7-4805-4120-9d15-d3bef27eb855 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.867679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 209/414] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 30 19:15:10 2022] PUT /identity/v3/projects/3e2ea3421608452eae39510625fcfc49/groups/871578975ba74ccca4540f667ebfd5b1/roles/e508ed31828645df8c584b7fbe1798e4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:10.877911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:10.882483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a13a7-ada5-4745-ae7c-1ff0f68d096a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:10.923804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87719bd4-a52f-4dff-89f2-92cc79a21c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:10.924847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87719bd4-a52f-4dff-89f2-92cc79a21c7b None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:10.925327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87719bd4-a52f-4dff-89f2-92cc79a21c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:10.925861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87719bd4-a52f-4dff-89f2-92cc79a21c7b None admin] PATH_INFO: `/v3/projects/6d3b383133b449569f26f949e441f7e5/groups/32f16186784146658ed2a081b2439a1d/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:10.928182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87719bd4-a52f-4dff-89f2-92cc79a21c7b None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3b383133b449569f26f949e441f7e5, group_id=32f16186784146658ed2a081b2439a1d, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:10.929832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87719bd4-a52f-4dff-89f2-92cc79a21c7b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:10.950459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 206/415] 10.222.0.18 () {58 vars in 1442 bytes} [Fri Sep 30 19:15:10 2022] PUT /identity/v3/projects/6d3b383133b449569f26f949e441f7e5/groups/32f16186784146658ed2a081b2439a1d/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:11.011098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24a4c-d9d0-47be-852b-122ae04a8c89 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:11.011721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24a4c-d9d0-47be-852b-122ae04a8c89 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:11.012290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a24a4c-d9d0-47be-852b-122ae04a8c89 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:11.013955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 210/416] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:11.015762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401361-5bb4-43f3-bd35-646b519b2c17 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:11.016266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401361-5bb4-43f3-bd35-646b519b2c17 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:11.016783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401361-5bb4-43f3-bd35-646b519b2c17 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:11.018532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 207/417] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:11.024176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68308421-df94-468b-ae2b-522fd985d2cc None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:11.024479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68308421-df94-468b-ae2b-522fd985d2cc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:11.024723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68308421-df94-468b-ae2b-522fd985d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:11.029283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107e92-a3b3-4c52-ad84-81d5bc478ddb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:11.029941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107e92-a3b3-4c52-ad84-81d5bc478ddb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:11.030475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107e92-a3b3-4c52-ad84-81d5bc478ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:11.054071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a2107e92-a3b3-4c52-ad84-81d5bc478ddb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:11.055893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a2107e92-a3b3-4c52-ad84-81d5bc478ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:11.067270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-68308421-df94-468b-ae2b-522fd985d2cc None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:11.068512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-68308421-df94-468b-ae2b-522fd985d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:11.150996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 208/418] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:11.186353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 211/419] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:11.430530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2107e92-a3b3-4c52-ad84-81d5bc478ddb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:11.506232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68308421-df94-468b-ae2b-522fd985d2cc None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:11.540982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:11.546751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2107e92-a3b3-4c52-ad84-81d5bc478ddb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:11.566421 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:11.586149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:11.586940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:11.587234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:11.587520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:11.598705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:11.604452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:11.605483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:11.606330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 209/420] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:15:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:11.612308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:11.723363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b03d-74de-48d4-9496-bd4149435f76 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:11.761965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:11.763002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:11.763286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:11.763563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:11.764292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:11.764604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:11.765987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:11.775937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 210/421] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:11.781475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:11.797194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68308421-df94-468b-ae2b-522fd985d2cc None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:11.806365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:11.867754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:11.868387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:11.868666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:11.869225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:11.889350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:11.894166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:11.895056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:11.895869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 212/422] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:11.905083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:11.968728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce4b92-a6f2-4326-bd8f-46e2bc551941 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:12.041440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:12.041935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.042237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.043630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.083361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:12.142335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b1f24-c2bd-4b7a-a1cf-037958976c31 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:12.207264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:12.208717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:12.214393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:12.215004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.215286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.215560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.216229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:12.216534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:12.217924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:12.235526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 213/423] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:15:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:12.240413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:12.243079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:12.408568 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 211/424] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:12.415230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:12.449809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417d633-b87f-4a1d-9735-096df32db0fb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:12.519888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d101ac0-b309-4ca8-9e68-0e2a1b4accf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:12.520520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d101ac0-b309-4ca8-9e68-0e2a1b4accf3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.520802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d101ac0-b309-4ca8-9e68-0e2a1b4accf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.521079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d101ac0-b309-4ca8-9e68-0e2a1b4accf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.552803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:12.604997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87779263-0c4c-4dd9-8525-97fdb6136b72 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:12.620021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:12.649075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:12.650178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.650657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.651169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.652678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:12.654336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:12.659212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 212/425] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:12 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:12.664234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:12.679453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d101ac0-b309-4ca8-9e68-0e2a1b4accf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:12.681309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d101ac0-b309-4ca8-9e68-0e2a1b4accf3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:12.789321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195b296-ea98-42e1-8b65-72c729851907 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:12.796263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 214/426] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:12.798525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0563-c529-443a-9219-7412865f372c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.799053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0563-c529-443a-9219-7412865f372c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.799477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0563-c529-443a-9219-7412865f372c None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.801781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 215/427] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:12.802793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0563-c529-443a-9219-7412865f372c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:12.832261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68749828-6c04-47bd-abb1-06ec3f98913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:12.833455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749828-6c04-47bd-abb1-06ec3f98913b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.834009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749828-6c04-47bd-abb1-06ec3f98913b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.834527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749828-6c04-47bd-abb1-06ec3f98913b None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.835949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68749828-6c04-47bd-abb1-06ec3f98913b None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:12.838284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68749828-6c04-47bd-abb1-06ec3f98913b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:12.845013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 213/428] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:12 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:12.846623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8f8b-a63e-44d3-8bac-8bf6764ebe36 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.847085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8f8b-a63e-44d3-8bac-8bf6764ebe36 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.847631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d8f8b-a63e-44d3-8bac-8bf6764ebe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.851379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:12.869297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3e5d8f8b-a63e-44d3-8bac-8bf6764ebe36 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:12.871051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3e5d8f8b-a63e-44d3-8bac-8bf6764ebe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:12.916288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0563-c529-443a-9219-7412865f372c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:12.919707 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:12.954362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 214/429] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:12.955750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d8f8b-a63e-44d3-8bac-8bf6764ebe36 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:12.955857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:12.956555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:12.956901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:12.957252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] PATH_INFO: `/v3/projects/22e698822779475e97944863e83b7475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:12.958511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] RBAC: Authorizing `identity:get_project(project_id=22e698822779475e97944863e83b7475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:12.960823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:12.962225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 216/430] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:12 2022] GET /identity/v3/projects/22e698822779475e97944863e83b7475 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:12.971664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:13.092430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d8f8b-a63e-44d3-8bac-8bf6764ebe36 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:13.137989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:13.138865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.139299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.139716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.140688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=22e698822779475e97944863e83b7475) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:13.141137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:13.142749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:13.149242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:12 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=22e698822779475e97944863e83b7475&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:13.172279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5a1be-9a80-415c-9bc1-65995462a938 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:13.190381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:13.226654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:13.227296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.227560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.227832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.235038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:13.236542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:13.238672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 217/432] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:12 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:13.244620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:13.326439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:13.340286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:13.404053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56770229-f918-4e09-9d11-cc60fe0bea65 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:13.456058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9e9b-a13c-44ea-8f3e-9eb08752ce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:13.456591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9e9b-a13c-44ea-8f3e-9eb08752ce6f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.456867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9e9b-a13c-44ea-8f3e-9eb08752ce6f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.457136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9e9b-a13c-44ea-8f3e-9eb08752ce6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.457969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9e9b-a13c-44ea-8f3e-9eb08752ce6f None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=101229ee973c472f99780a668e4c403f, scope.project.id=22e698822779475e97944863e83b7475) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:13.458309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9e9b-a13c-44ea-8f3e-9eb08752ce6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:13.459877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f9e9b-a13c-44ea-8f3e-9eb08752ce6f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:13.468541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 216/433] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:13 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=22e698822779475e97944863e83b7475&role.id=101229ee973c472f99780a668e4c403f => generated 611 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:13.503549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05a388-9176-4473-85b5-505d1c35848e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:13.541620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:13.542306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.542634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.542903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.560163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:13.565423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:13.566408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:13.567311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 218/434] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:13.569006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b2e2-d104-4953-89f6-d2f741fad6b4 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.569287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b2e2-d104-4953-89f6-d2f741fad6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.569553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2b2e2-d104-4953-89f6-d2f741fad6b4 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.570967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 217/435] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:15:13.572411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:13.578662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f016ea-a689-4a1b-96ff-f2962c536c00 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.578987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f016ea-a689-4a1b-96ff-f2962c536c00 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.579209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f016ea-a689-4a1b-96ff-f2962c536c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.603213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-31f016ea-a689-4a1b-96ff-f2962c536c00 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:13.605417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-31f016ea-a689-4a1b-96ff-f2962c536c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:13.622522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:13.683265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 218/436] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:13.684842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282d82-399c-4af3-a456-0694750e45df None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.685255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282d82-399c-4af3-a456-0694750e45df None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.685664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282d82-399c-4af3-a456-0694750e45df None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.687071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 219/437] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:13.692337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7ce5-040f-4558-8c2a-d0ac006c80cb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.692785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7ce5-040f-4558-8c2a-d0ac006c80cb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.693213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7ce5-040f-4558-8c2a-d0ac006c80cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.700243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc301a-a744-4c6f-a322-e8da72607f20 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:13.712154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-52dd7ce5-040f-4558-8c2a-d0ac006c80cb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:13.714192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-52dd7ce5-040f-4558-8c2a-d0ac006c80cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:13.744689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:13.745309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.745588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.745860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.746560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:13.746866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:13.748257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:13.749556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:13.757854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 219/438] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:15:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:13.764724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:13.803780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 220/439] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:13.873744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:13.876809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757a321-91f3-43f9-8e3a-e493b6e81bb6 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:13.913938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:13.914572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:13.914851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:13.915123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:13.961777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd7ce5-040f-4558-8c2a-d0ac006c80cb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:13.995948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:13.997298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.093765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd7ce5-040f-4558-8c2a-d0ac006c80cb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.113825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.119869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 220/440] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:15:14.120794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.134138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.134138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.134138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.134138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.146609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:14.152291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:14.153186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 221/441] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:15:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:14.154471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.186210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.242363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dea045-222e-482a-8dcc-d091814cab7d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.268278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec498-e962-415e-956c-8aadfb9502e4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.278845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.279480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.279760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.280033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.289954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:14.295043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:14.296048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 221/442] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:14.296883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.303113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.303738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.304013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.304305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.305414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:14.307443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.309038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 222/443] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:14.309779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.359259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.400502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1d4ec-c0da-49ba-b656-508437b34602 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.400718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.407860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989373-019e-4fea-9d26-6a57d893d5cb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.435103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.435755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.435982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.436256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.436916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:14.437221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:14.438686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.441131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.441731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.442006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.442301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.442952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:14.443249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:14.444576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.446608 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:14.447953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.453703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 223/445] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:14.454850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.546701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf864-034e-421b-8acd-aa7fb71e28e8 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.556040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec7929-5eb3-43f3-9169-27af80435de4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.568644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.588839 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.589329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.589470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.589751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.589924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.590016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.590228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.590495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.591156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:14.592591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.599001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 223/446] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:14.599001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.615462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.659808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:14.661574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.694946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d453d-abad-426c-92cb-e34be04e0937 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.727025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.727627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.727908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.728765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.760763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 224/447] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:14.761672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.789005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.801217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:14.802714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.817620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:14.862711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de246b-31f0-4dc5-9061-72d91edf64c3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:14.897690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:14.898304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:14.898578 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:14.898844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:14.899559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=101229ee973c472f99780a668e4c403f, scope.project.id=3e2ea3421608452eae39510625fcfc49) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:14.899859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:14.901318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 224/448] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:14.901804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:14.902175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:14.919771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 225/449] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=101229ee973c472f99780a668e4c403f => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:14.919771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:15.010422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:15.021621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5d26-36a8-4a80-a8bf-327f03d2d1a5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:15.022588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db7a1a-d021-4ec0-aa7c-ed2d3e53a408 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:15.046639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:15.064077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:15.064718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:15.065001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:15.065268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] PATH_INFO: `/v3/projects/6d3b383133b449569f26f949e441f7e5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:15.066524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] RBAC: Authorizing `identity:get_project(project_id=6d3b383133b449569f26f949e441f7e5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:15.067875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:15.067992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:15.068519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:15.068799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:15.069064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] PATH_INFO: `/v3/projects/3e2ea3421608452eae39510625fcfc49` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:15.069829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 226/450] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/projects/6d3b383133b449569f26f949e441f7e5 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:15.070535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] RBAC: Authorizing `identity:get_project(project_id=3e2ea3421608452eae39510625fcfc49)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:15.072139 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:15.078386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:15:14 2022] GET /identity/v3/projects/3e2ea3421608452eae39510625fcfc49 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:15.079168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:15.080377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:15.206041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f56e1-5676-4be3-a9f7-4649bb412da9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:15.209606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ea2b1-f431-440b-b5d8-7af546789acd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:15.247405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:15.247923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:15.248011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:15.248263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] PATH_INFO: `/v3/groups/32f16186784146658ed2a081b2439a1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:15.250083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] RBAC: Authorizing `identity:get_group(group_id=32f16186784146658ed2a081b2439a1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:15.251509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:15.252817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:15.254088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 226/452] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:15 2022] GET /identity/v3/groups/32f16186784146658ed2a081b2439a1d => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:15.254202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:15.254202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:15.254202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] PATH_INFO: `/v3/groups/871578975ba74ccca4540f667ebfd5b1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:15.255594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] RBAC: Authorizing `identity:get_group(group_id=871578975ba74ccca4540f667ebfd5b1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:15.257028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:15.258739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1180 bytes} [Fri Sep 30 19:15:15 2022] GET /identity/v3/groups/871578975ba74ccca4540f667ebfd5b1 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:15.260762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:15.265555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:15.289925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:15.328152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:15.363188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cbd1-e878-4a43-af3c-ee9f3518f697 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:15.372939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d13ad-452e-4018-b58f-7d998cce2306 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:15.396040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b37b26-fe94-43de-8572-f5a4d35c5904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:15.396644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b37b26-fe94-43de-8572-f5a4d35c5904 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:15.396921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b37b26-fe94-43de-8572-f5a4d35c5904 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:15.397194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b37b26-fe94-43de-8572-f5a4d35c5904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:15.397909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b37b26-fe94-43de-8572-f5a4d35c5904 None admin] RBAC: Adding query filter params (group.id=32f16186784146658ed2a081b2439a1d, role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=6d3b383133b449569f26f949e441f7e5) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:15.398248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b37b26-fe94-43de-8572-f5a4d35c5904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:15.399676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b37b26-fe94-43de-8572-f5a4d35c5904 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:15.405479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8352369-3cb1-498b-a579-667ea97a8306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:15.405733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:15 2022] GET /identity/v3/role_assignments?group.id=32f16186784146658ed2a081b2439a1d&scope.project.id=6d3b383133b449569f26f949e441f7e5&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:15.406109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352369-3cb1-498b-a579-667ea97a8306 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:15.406394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352369-3cb1-498b-a579-667ea97a8306 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:15.406667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8352369-3cb1-498b-a579-667ea97a8306 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:15.407384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8352369-3cb1-498b-a579-667ea97a8306 None admin] RBAC: Adding query filter params (group.id=871578975ba74ccca4540f667ebfd5b1, role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=3e2ea3421608452eae39510625fcfc49) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:15.407694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8352369-3cb1-498b-a579-667ea97a8306 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:15.409132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8352369-3cb1-498b-a579-667ea97a8306 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:15.416130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 228/455] 10.222.0.18 () {56 vars in 1376 bytes} [Fri Sep 30 19:15:15 2022] GET /identity/v3/role_assignments?group.id=871578975ba74ccca4540f667ebfd5b1&scope.project.id=3e2ea3421608452eae39510625fcfc49&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:18.208841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b236-3d14-491a-915c-e0ba7d3f93a6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:18.209404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b236-3d14-491a-915c-e0ba7d3f93a6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:18.209404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b236-3d14-491a-915c-e0ba7d3f93a6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:18.210789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 228/456] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:18.216751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abf6d5-cdf9-495d-9d88-5240a97e114c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:18.217485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abf6d5-cdf9-495d-9d88-5240a97e114c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:18.217901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abf6d5-cdf9-495d-9d88-5240a97e114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:18.247988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-76abf6d5-cdf9-495d-9d88-5240a97e114c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:18.249454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-76abf6d5-cdf9-495d-9d88-5240a97e114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:18.339654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 229/457] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:18.621662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516bb9-87bb-41ac-9d12-36755a16d587 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:18.622185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516bb9-87bb-41ac-9d12-36755a16d587 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:18.622624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50516bb9-87bb-41ac-9d12-36755a16d587 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:18.624102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:18.637800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2e25-7ecf-463c-b74e-d25c2b3fcb66 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:18.638295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2e25-7ecf-463c-b74e-d25c2b3fcb66 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:18.638712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed2e25-7ecf-463c-b74e-d25c2b3fcb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:18.660903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7eed2e25-7ecf-463c-b74e-d25c2b3fcb66 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:18.662416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7eed2e25-7ecf-463c-b74e-d25c2b3fcb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:18.698701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516bb9-87bb-41ac-9d12-36755a16d587 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:18.722485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:18.750223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 230/459] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:18.758075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee104-7b42-4029-a152-47b077d020ca None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:18.758075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee104-7b42-4029-a152-47b077d020ca None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:18.758075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee104-7b42-4029-a152-47b077d020ca None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:18.758075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 231/460] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:18.759088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f3028-28e8-4b76-93cc-9d5e4336862d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:18.759485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f3028-28e8-4b76-93cc-9d5e4336862d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:18.759814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f3028-28e8-4b76-93cc-9d5e4336862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:18.784915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-df4f3028-28e8-4b76-93cc-9d5e4336862d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:18.786115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-df4f3028-28e8-4b76-93cc-9d5e4336862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:18.875887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:18.897916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50516bb9-87bb-41ac-9d12-36755a16d587 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:18.911760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 232/461] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:18.941103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4e829-e283-434e-9ccd-6ef2583afba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:18.941733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4e829-e283-434e-9ccd-6ef2583afba4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:18.942008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4e829-e283-434e-9ccd-6ef2583afba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:18.942298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4e829-e283-434e-9ccd-6ef2583afba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:18.954179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4e829-e283-434e-9ccd-6ef2583afba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:18.955625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4e829-e283-434e-9ccd-6ef2583afba4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-8fc4e829-e283-434e-9ccd-6ef2583afba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:18.971140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:18.972150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:18.973028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:18.973028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:18.973028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:18.973028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 230/462] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:18.983144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f3028-28e8-4b76-93cc-9d5e4336862d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.022317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc15be-00d7-46ea-b11f-fc51909f312a None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.022682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc15be-00d7-46ea-b11f-fc51909f312a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.022861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc15be-00d7-46ea-b11f-fc51909f312a None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.024168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 231/463] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:15:19.029320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857543-6ffc-4262-ae4e-329cd7c9ad81 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.029594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857543-6ffc-4262-ae4e-329cd7c9ad81 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.029862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f857543-6ffc-4262-ae4e-329cd7c9ad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.063968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5f857543-6ffc-4262-ae4e-329cd7c9ad81 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:19.065164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5f857543-6ffc-4262-ae4e-329cd7c9ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:19.137773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 232/464] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 30 19:15:19.138689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857543-6ffc-4262-ae4e-329cd7c9ad81 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.140350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f3028-28e8-4b76-93cc-9d5e4336862d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:19.159685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:19.190138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:19.191181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.191932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.192410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.193260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:19.193844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:19.195893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:19.210144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 233/465] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:19.216204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.277491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:19.318964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f857543-6ffc-4262-ae4e-329cd7c9ad81 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:19.354535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42327c4-2713-4fcc-8f49-48fb9a37a780 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:19.369042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:19.369876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.370321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.370787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.386617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:19.388337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:19.398136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:19.398962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.399399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.399866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.401444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:19.403486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:19.409283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:19.410431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:19.411512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:19.411512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:19.411512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:19.418074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 233/466] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:19.418074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.437834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 234/467] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:15:19 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:19.439007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.473099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:19.571053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168262-9070-49ee-ab8c-57d00c62046d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:19.573033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ebd28-b90d-4c72-82b8-e4a5cb8c24eb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:19.609353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:19.614471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:19.615374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.615871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.617181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.618946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:19.619647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:19.621299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:19.625058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:19.625691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.625968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.626303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.638088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 235/468] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:19.638831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.641972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:19.642740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:19.657883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:19.659043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:19.659942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:19.659942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:19.659942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:19.659942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 234/469] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:19.660670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.772612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:19.787251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803dc1c-7fe0-44ef-ba73-6d9019553835 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:19.792113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeff53-848f-4fd0-a399-bcaa345826f0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:19.829701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:19.830649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.831023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.831412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.839522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:19.841208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:19.841646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:19.842079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:19.843540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:19.845377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:19.845705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:19.847105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:19.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:19.868801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:19.870070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:19.870070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:19.870070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:19.876216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 236/471] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:19.876366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 235/471] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:15:19 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:19.877434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.879189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:19.932702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:20.016641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14174dfa-2109-4849-aca9-f345d1f578f5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:20.057800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e310e60-69e4-47d0-93ac-7428177aa850 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:20.059855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d736d-f9b7-4008-954f-c01269492500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:20.060583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d736d-f9b7-4008-954f-c01269492500 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.061028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d736d-f9b7-4008-954f-c01269492500 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.061390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d736d-f9b7-4008-954f-c01269492500 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.062221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d736d-f9b7-4008-954f-c01269492500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:20.062636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d736d-f9b7-4008-954f-c01269492500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:20.064196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d736d-f9b7-4008-954f-c01269492500 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:20.074104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:20.083573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 237/472] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:20.085088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334be9fa-9b20-42fd-b01d-4f7c3d87e90f None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.085505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334be9fa-9b20-42fd-b01d-4f7c3d87e90f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.085936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334be9fa-9b20-42fd-b01d-4f7c3d87e90f None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.092686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 238/473] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:20.092686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334be9fa-9b20-42fd-b01d-4f7c3d87e90f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:20.111542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00490f-e295-478e-866d-06eb70c63e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:20.112160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00490f-e295-478e-866d-06eb70c63e66 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.112441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00490f-e295-478e-866d-06eb70c63e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.112711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00490f-e295-478e-866d-06eb70c63e66 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.113356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00490f-e295-478e-866d-06eb70c63e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:20.113659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00490f-e295-478e-866d-06eb70c63e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:20.115063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00490f-e295-478e-866d-06eb70c63e66 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:20.134566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 236/474] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:20.135863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e7e6-5931-4047-8daf-b70498d18594 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.136036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e7e6-5931-4047-8daf-b70498d18594 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.136302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578e7e6-5931-4047-8daf-b70498d18594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.157954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f578e7e6-5931-4047-8daf-b70498d18594 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:20.159505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f578e7e6-5931-4047-8daf-b70498d18594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:20.238555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 237/475] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:20.239395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578e7e6-5931-4047-8daf-b70498d18594 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:20.240255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334be9fa-9b20-42fd-b01d-4f7c3d87e90f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:20.264524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:20.284741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:20.286007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.286795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.287289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.288141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:20.289766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:20.316920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 239/476] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:15:20 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:20.370940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578e7e6-5931-4047-8daf-b70498d18594 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:20.420215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:20.420838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.421110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.421375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.422026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:20.423507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:20.459417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 238/477] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:15:20 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:20.579667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:20.657480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:20.711400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143a5c-7144-4179-ae43-1fcd97f80e6c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:20.746450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:20.747063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.747343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.747619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.748289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:20.749749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:20.760310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.sql.core [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 19:15:20.760310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 19:15:20.760310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [parameters: {'id': 'e6844b5a3aff41dc9123a9aa26bea432', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 19:15:20.760310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 30 19:15:20.777258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return ref.to_dict() Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 19:15:20.778260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application yield resource Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise self.value Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application session.commit() Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 19:15:20.779451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.flush() Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application compat.raise_( Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 19:15:20.780479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 19:15:20.781356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 19:15:20.782255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [parameters: {'id': 'e6844b5a3aff41dc9123a9aa26bea432', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:20.784113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 30 19:15:20.787407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:20.789359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 240/478] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 30 19:15:20 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:20.789527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:20.912798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:20.938181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7503a8-6bd4-43dc-bc73-f042dde70dbf None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:20.975036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65a081-c3d3-4a5b-a308-8dcab26bd596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:20.975666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a081-c3d3-4a5b-a308-8dcab26bd596 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:20.975943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a081-c3d3-4a5b-a308-8dcab26bd596 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:20.976212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65a081-c3d3-4a5b-a308-8dcab26bd596 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:20.987232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65a081-c3d3-4a5b-a308-8dcab26bd596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-6a65a081-c3d3-4a5b-a308-8dcab26bd596 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:20.992493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:20.995205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:20.997230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 239/479] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:21.000577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:21.161685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c5e1a-60b0-4605-b57f-ac7574a991e4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:21.179767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:21.200422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39a080-ca32-4e5d-8921-62aca413cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:21.201034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a080-ca32-4e5d-8921-62aca413cd83 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:21.201313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a080-ca32-4e5d-8921-62aca413cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:21.201590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39a080-ca32-4e5d-8921-62aca413cd83 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:21.202289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39a080-ca32-4e5d-8921-62aca413cd83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:21.202595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39a080-ca32-4e5d-8921-62aca413cd83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:21.204097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39a080-ca32-4e5d-8921-62aca413cd83 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:21.213468 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 241/480] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:22.110609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2d253-1aaa-4e1c-afc0-9d55ee8bd11a None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:22.111138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2d253-1aaa-4e1c-afc0-9d55ee8bd11a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:22.111138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2d253-1aaa-4e1c-afc0-9d55ee8bd11a None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:22.112746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 240/481] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:22.120160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3808b2b-7b47-48e4-bb85-f491c6431a96 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:22.120576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3808b2b-7b47-48e4-bb85-f491c6431a96 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:22.120780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3808b2b-7b47-48e4-bb85-f491c6431a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:22.147520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d3808b2b-7b47-48e4-bb85-f491c6431a96 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:22.148716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d3808b2b-7b47-48e4-bb85-f491c6431a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:22.241695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 242/482] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:22.607946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2d253-1aaa-4e1c-afc0-9d55ee8bd11a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:22.756844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2d253-1aaa-4e1c-afc0-9d55ee8bd11a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:22.777582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd9bc6-bb38-4425-91dd-25f45bb4dabe None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:22.777944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd9bc6-bb38-4425-91dd-25f45bb4dabe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:22.778174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd9bc6-bb38-4425-91dd-25f45bb4dabe None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:22.779783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 243/483] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:22.801623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:22.802603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:22.803094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:22.803553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:22.809729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810e9d3-d88d-4f91-bdf4-16b30035c4ea None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:22.810277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810e9d3-d88d-4f91-bdf4-16b30035c4ea None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:22.810740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810e9d3-d88d-4f91-bdf4-16b30035c4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:22.826969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:22.827944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:22.832826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:22.833716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:22.834923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 241/484] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:22.844150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:22.846873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6810e9d3-d88d-4f91-bdf4-16b30035c4ea None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:22.848082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6810e9d3-d88d-4f91-bdf4-16b30035c4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:23.009281 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0478c61-42e4-42bd-bb2c-c6ab45dd245f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:23.027826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 244/485] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:23.095373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:23.096015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.096303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.096584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.097266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:23.097576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:23.099015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:23.104756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7eebd-29db-4dac-9fea-ce02300a8ce1 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.107979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7eebd-29db-4dac-9fea-ce02300a8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.107979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7eebd-29db-4dac-9fea-ce02300a8ce1 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.107979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 245/486] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:15:23.111960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aec6cf-aad3-47d0-8727-0901e0e014aa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.112250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aec6cf-aad3-47d0-8727-0901e0e014aa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.112526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aec6cf-aad3-47d0-8727-0901e0e014aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.124171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 242/487] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:23.130668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:23.162936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-32aec6cf-aad3-47d0-8727-0901e0e014aa None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:23.164197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-32aec6cf-aad3-47d0-8727-0901e0e014aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:23.242418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:23.301744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:23.344138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 246/488] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:23.383425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aec6cf-aad3-47d0-8727-0901e0e014aa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:23.428073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232f56-2e06-4fca-a983-5bf54a49e210 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:23.527253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df31b04-0b71-4df1-b0f1-a2d38ab85b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:23.527479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31b04-0b71-4df1-b0f1-a2d38ab85b40 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.527780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31b04-0b71-4df1-b0f1-a2d38ab85b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.529910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31b04-0b71-4df1-b0f1-a2d38ab85b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.559299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df31b04-0b71-4df1-b0f1-a2d38ab85b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:23.561628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df31b04-0b71-4df1-b0f1-a2d38ab85b40 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-9df31b04-0b71-4df1-b0f1-a2d38ab85b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:23.592436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:23.594511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:23.595418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:23.595418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:23.595418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:23.598916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 243/489] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:23.600362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d344c33-198e-444b-84fc-1eb02c88113b None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.600647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d344c33-198e-444b-84fc-1eb02c88113b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.600920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d344c33-198e-444b-84fc-1eb02c88113b None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.607711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 244/490] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:23.607711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d344c33-198e-444b-84fc-1eb02c88113b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:23.614405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aec6cf-aad3-47d0-8727-0901e0e014aa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:23.650761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24820218-50b9-4090-9068-fb45ee3cd208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:23.651393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820218-50b9-4090-9068-fb45ee3cd208 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.651669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820218-50b9-4090-9068-fb45ee3cd208 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.651937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24820218-50b9-4090-9068-fb45ee3cd208 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.662584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24820218-50b9-4090-9068-fb45ee3cd208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-24820218-50b9-4090-9068-fb45ee3cd208 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:23.668206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:23.669335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:23.671300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:23.674410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 247/491] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:23.675648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632de53-2c05-45cf-bcf7-827879db4391 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.676017 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632de53-2c05-45cf-bcf7-827879db4391 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.676193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632de53-2c05-45cf-bcf7-827879db4391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.694825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5632de53-2c05-45cf-bcf7-827879db4391 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:23.695997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5632de53-2c05-45cf-bcf7-827879db4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:23.721828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d344c33-198e-444b-84fc-1eb02c88113b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:23.722012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:23.735660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:23.759191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:23.760073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.760352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.760635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.761270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:23.761576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:23.763000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:23.768875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 248/492] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:23.769937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632de53-2c05-45cf-bcf7-827879db4391 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:23.776205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 245/493] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:23.776884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:23.893638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632de53-2c05-45cf-bcf7-827879db4391 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:23.908473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351caefe-f176-422f-a4ab-dcf7f378efbe None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:23.943314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:23.944527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.945471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.946870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.947893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:23.948415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:23.950258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:23.951045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:23.951763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:23.952111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:23.952473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:23.964210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 249/494] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:23.965617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:23.965814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:23.970803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:23.971797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:23.972627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:23.976813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 246/495] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:23.978251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.000504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.015198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.094601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f3ae-6da9-4aba-bd7d-54b851fd381a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.097813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c1830-56a8-4af8-875a-6373ea072fc6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.127602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c1ece-dd50-40c7-9bb1-cf0b4e837d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.128312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1ece-dd50-40c7-9bb1-cf0b4e837d01 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.128589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1ece-dd50-40c7-9bb1-cf0b4e837d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.128859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c1ece-dd50-40c7-9bb1-cf0b4e837d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.132397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.133020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.133301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.133693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.138840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1ece-dd50-40c7-9bb1-cf0b4e837d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.140286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c1ece-dd50-40c7-9bb1-cf0b4e837d01 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.140643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.142095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-061c1ece-dd50-40c7-9bb1-cf0b4e837d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:24.154937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:24.156007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:24.157091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:24.157091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:24.157091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:24.157306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:24.158334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 250/496] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:15:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:24.159479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.164278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 247/497] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:24.164278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6babe8c-0e07-489d-b379-86a5249da6fe None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.164278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6babe8c-0e07-489d-b379-86a5249da6fe None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.164278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6babe8c-0e07-489d-b379-86a5249da6fe None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.164884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 248/498] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:24.166149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6babe8c-0e07-489d-b379-86a5249da6fe None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.240799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.251106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.261181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36003103-aeca-411a-afb2-8c9b2977380a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.268681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6babe8c-0e07-489d-b379-86a5249da6fe None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.295832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.296433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.296816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.296981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.297644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:24.297948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.299356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.302021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.302660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.302936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.303204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.308398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 251/499] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:24.309245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.314434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:24.319120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:24.320060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:24.320894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 249/500] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:24.321736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.409065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840850b3-f37e-4d3e-a16f-fb526c8001a6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.419400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170822f1-fca7-4681-b71c-c5a4cbebd731 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.441287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.442229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.442511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.442781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.443496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:24.443799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.445222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.452306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f5cd2-4b41-4280-a1ae-259d6293dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.452905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f5cd2-4b41-4280-a1ae-259d6293dc44 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.453186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f5cd2-4b41-4280-a1ae-259d6293dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.453460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f5cd2-4b41-4280-a1ae-259d6293dc44 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.454123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f5cd2-4b41-4280-a1ae-259d6293dc44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:24.454431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f5cd2-4b41-4280-a1ae-259d6293dc44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.455808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f5cd2-4b41-4280-a1ae-259d6293dc44 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.468734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 250/501] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:24.469911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c2d97-779f-46ef-b633-d77899b8fb87 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.470224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c2d97-779f-46ef-b633-d77899b8fb87 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.470497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c2d97-779f-46ef-b633-d77899b8fb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.477337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.485075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 252/502] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:24.485889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.489759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-743c2d97-779f-46ef-b633-d77899b8fb87 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:24.489876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.490626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-743c2d97-779f-46ef-b633-d77899b8fb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:24.557765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 251/503] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:24.558644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c2d97-779f-46ef-b633-d77899b8fb87 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.588408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d3fc3-d058-4ccd-b569-beae5f231736 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.624496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.625432 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.625852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.626311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.638243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.639940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:24.655262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:24.656390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:24.657293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:24.657293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:24.657293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:24.657293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 253/504] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:24.657510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.674327 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c2d97-779f-46ef-b633-d77899b8fb87 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.709979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.710629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.710903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.711173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.712368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:24.712671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.714039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.715501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.728222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 252/505] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:24.728380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.728487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.778066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264c0af-9e62-4285-aede-7ae0386c9084 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.813517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.814413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.814834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.815275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.824697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.827043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.832750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808ec38-b1cf-45c3-aee0-4b886b5f7b5d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:24.838907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:24.839967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 254/506] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:24.840863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:24.872528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.873133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.873419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.873693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.935291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.943095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.944570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.944729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446cf52-bf1c-46eb-b7ad-b8ac2f94e551 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:24.958470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:24.981259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:24.981861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:24.982169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:24.982442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:24.983096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:24.983391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:24.984752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:24.996859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 255/507] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:24.997650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.054539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 253/508] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:25.056086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.103780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cded49-4788-4138-a173-42f4b26b9619 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.136782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.137391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.137667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.137934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.149171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.150553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.150991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.156617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b98dd-012e-4193-aad0-12b1b554bd37 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:25.166672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:25.172402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:25.173289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:25.173289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:25.173289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:25.173289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 256/509] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:25.173289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.196797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.197051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.197665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.197939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.198240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.208420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.209901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:25.225287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:25.226416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:25.227978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:25.227978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:25.227978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:25.227978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 254/510] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:25.227978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.273256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc479fa4-46dc-4eca-86c6-40e8225f0095 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.307715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.308728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.309151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.309422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.310174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:25.310482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.311897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.326007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdb411-4725-436b-be4b-5559c86ac58d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.329553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 257/511] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:25.330374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.360623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.361248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.361529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.361806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.369596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.371081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:25.384386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:25.385289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 19:15:25.386234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:25.390287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 255/512] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:25.390997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.402214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.412546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.428783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965304-e1aa-41f8-b2a6-dc7d64d71f9b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.464091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.464645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.464921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.465190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.475857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.477308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.490307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a2e7-dcbb-4988-9333-bd3e39d5c25e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:25.491378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:25.492295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:25.493671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:25.493671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:25.493671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:25.493671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 258/513] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:25.494161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.527507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.528107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.528380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.528649 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.529276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:25.529576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.530987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.542858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 256/514] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:25.543638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.594169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602d39c-0b41-4d59-835b-6d1fcee3fa76 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.608790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.627486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.628082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.628358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.628626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.629252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:25.629810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.631189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.635024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.643767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6a839-cfd7-41b4-8b95-9d1e466dd640 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.644801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 259/515] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:25.645418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.678435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.679037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.679315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.679594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.744020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba59af-56ca-4fa4-ba30-8f189b96f90a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.746367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.747895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.777745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.778372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.778645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.778910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.779625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:25.779923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.781352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.798934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 260/516] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:25.799740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.816021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.850489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 257/517] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:25.851318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.856204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:25.908072 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f320a-fae2-4077-9651-cdae2ab0afc6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.943055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.943647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.943951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.944216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.944846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:25.945141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.946769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:25.950679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be63e0-9396-41e8-adeb-7f96ee96fe4a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:25.957681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 261/518] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:25.958476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:25.984864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:25.985485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:25.985762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:25.986030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:25.993687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:25.995226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:26.006652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:26.007726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 258/519] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:26.009536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.036301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.067410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538170f1-d286-49f8-b27f-4b4a0d764f91 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.083596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.104006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.104599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.104873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.105142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.105774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.107231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.109762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c9636-43db-4c73-a07e-e035f97587b7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.128298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 262/520] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:15:25 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:26.129228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.155541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.156175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.156435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.156770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.236365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.238447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.250839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce10a08-5679-4190-a7fb-9f77236f8bf2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.270181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.290114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.290828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.291110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.291384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.303189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.304644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:26.321060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:26.322112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:26.324186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:26.324186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:26.324186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:26.324186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 263/521] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:26.324186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.354256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.369012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 259/522] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:26.369012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.439869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee603805-185e-40a9-9376-9570db7a35a5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.472450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa5071-02d0-4b2e-8bae-756e18a934ec None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.477214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.478071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.478669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.479127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.486350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.487803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.500586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:26.501972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:26.502995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:26.503856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:26.507554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 264/523] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:26.508487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.511685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.512302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.512578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.512853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.513582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:26.513890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.515362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.554025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 260/524] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:26.554895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.600520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.621693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6197a-9a1b-45b9-9ac6-3f72dfa1f1b1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.659967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.660578 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.660858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.661129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.661782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:26.662098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.663467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.664088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203793d-4ea7-4c7d-a946-6a04b3c142df None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.679013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 265/525] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:26.679854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.714152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.715099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.715788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.717066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.731015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.733123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:26.750408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:26.751336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:26.752259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:26.752259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:26.752259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:26.753690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 261/526] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:26.754987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.783752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893571e-be22-44be-8b1c-68ac301ac51e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.803576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.823432 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.824064 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.824346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.824622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.825316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:26.825621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.827073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:26.845746 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 266/527] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:26.846541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:26.850785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:26.876218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5791650-7b64-4dc0-b9c6-a9ed05f03cc2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.918350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:26.919353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:26.919633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:26.920051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:26.964503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac66eb-2aac-4681-9222-35af5e5a7433 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:26.991021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:26.992474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.001256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.001881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.002186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.002525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.011061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.012642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:27.026799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:27.027697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:27.028536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 267/528] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:27.029001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.037176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:27.102405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:27.113333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 262/529] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:27.113333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.151286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc4789-180f-465f-8afe-eefffbf09163 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.189347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.190168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.190411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.190752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.191483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:27.191881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.193295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.205680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 268/530] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:27.206485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.218992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ee01-ae2b-4c93-9dfb-0d10a0dbfda9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.254039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.254961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.255329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.255606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.256318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=57667fb21646457b8871087abcbd978c) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:27.256625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.258085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.268985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 263/531] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/role_assignments?user.id=57667fb21646457b8871087abcbd978c&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:27.268985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.268985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:27.345434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1446775-ca09-4a54-b2fc-2c850f2abb96 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.373820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:27.389005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.389778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.390086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.390355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.391123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:27.391429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.392891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.411028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 269/532] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:27.412003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.412627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c560b-e413-4b4a-af4f-02207194534c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.452228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.453220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.453501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.453776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.467625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.469108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:27.485021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:27.485988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:27.486882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:27.486882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:27.486882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:27.486882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 264/533] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:27.487534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.529444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e789-4ede-4324-9a6e-066518707b22 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.549749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:27.570624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.571984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.572342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.572646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.581576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.583078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:27.597880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:27.598780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:27.599655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:27.600081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240b217-73ae-4342-b372-6bfe7ec92ad5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.603030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 270/534] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:27.603353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.641269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.641881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.642185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.642459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.643339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=d267807215f54e2ea4c91383b178ee25) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:27.643790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.645238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.651450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 265/535] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/role_assignments?user.id=d267807215f54e2ea4c91383b178ee25&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:27.652329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.658027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:27.729411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a238af-c412-48d4-9dd8-983566eaed42 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.769837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab0324-2cad-417e-907d-789c106eead1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.775595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.776224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.776506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.776778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.777514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:27.777825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.780475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.790927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:27.797814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 271/536] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:27.807946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.829039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:27.829830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:27.830154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:27.830435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:27.831151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:27.831461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:27.832958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:27.869054 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 266/537] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:27.875438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:27.981713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddefe8-67f3-4260-84b3-175211f023cb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:27.984657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:28.049952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:28.050620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:28.050899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:28.051172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:28.066103 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:28.067523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:28.080553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:28.081495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:28.082400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 272/538] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:28.087227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:28.087806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20880a4a-499d-47ea-ac01-3876ad807b83 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:28.158442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:28.159056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:28.159335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:28.159606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:28.160343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=9f5190ae783a4c89b51797729aaaa6ff) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:28.160650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:28.162117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:28.174077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 267/539] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:27 2022] GET /identity/v3/role_assignments?user.id=9f5190ae783a4c89b51797729aaaa6ff&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:28.269224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed6189-4133-4006-973b-0cd00d3b0788 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:28.319285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d44da-ced9-43a0-a7f7-ed622af6b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:28.320233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d44da-ced9-43a0-a7f7-ed622af6b511 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:28.321369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d44da-ced9-43a0-a7f7-ed622af6b511 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:28.322122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d44da-ced9-43a0-a7f7-ed622af6b511 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:28.323222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d44da-ced9-43a0-a7f7-ed622af6b511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:28.323790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d44da-ced9-43a0-a7f7-ed622af6b511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:28.325597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d44da-ced9-43a0-a7f7-ed622af6b511 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:28.344225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 273/540] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:28.350312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:28.429478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:28.530540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84fa93-486b-4b22-8286-ac56b30596b8 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:28.582460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a750083-11f3-4689-94f6-0e67b8d79942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:28.582991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a750083-11f3-4689-94f6-0e67b8d79942 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:28.583273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a750083-11f3-4689-94f6-0e67b8d79942 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:28.583545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a750083-11f3-4689-94f6-0e67b8d79942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:28.584278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a750083-11f3-4689-94f6-0e67b8d79942 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=38287d3f91704657bc26c5b4d50c0315) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:28.584584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a750083-11f3-4689-94f6-0e67b8d79942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:28.586110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a750083-11f3-4689-94f6-0e67b8d79942 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:28.592396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 268/541] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:28 2022] GET /identity/v3/role_assignments?user.id=38287d3f91704657bc26c5b4d50c0315&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:28.683401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b3a5-1032-4962-86c1-9f9cf19bfd55 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:28.684415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b3a5-1032-4962-86c1-9f9cf19bfd55 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:28.684893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b3a5-1032-4962-86c1-9f9cf19bfd55 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:28.686861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 274/542] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:28.692376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af588d-f970-4aaf-8491-100bde83086a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:28.692671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af588d-f970-4aaf-8491-100bde83086a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:28.692936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af588d-f970-4aaf-8491-100bde83086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:28.722726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e4af588d-f970-4aaf-8491-100bde83086a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:28.724328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e4af588d-f970-4aaf-8491-100bde83086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:28.826427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 269/543] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:29.116699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144b3a5-1032-4962-86c1-9f9cf19bfd55 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:29.148732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:29.260525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144b3a5-1032-4962-86c1-9f9cf19bfd55 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:29.308782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:29.309421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:29.309698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:29.309969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:29.328068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:29.332779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:29.333672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:29.334511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 275/544] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:29.340601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af588d-f970-4aaf-8491-100bde83086a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:29.386779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:29.474433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af588d-f970-4aaf-8491-100bde83086a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:29.521797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aa3cd-fd61-4dc2-95af-2325168ec093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:29.522433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa3cd-fd61-4dc2-95af-2325168ec093 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:29.522710 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa3cd-fd61-4dc2-95af-2325168ec093 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:29.522978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aa3cd-fd61-4dc2-95af-2325168ec093 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:29.524160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aa3cd-fd61-4dc2-95af-2325168ec093 None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:29.524651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aa3cd-fd61-4dc2-95af-2325168ec093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:29.526314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aa3cd-fd61-4dc2-95af-2325168ec093 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:29.537230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 270/545] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:29.542683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:29.657140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:29.684846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117185-075f-47a2-96b0-ba0d5b21c5b3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:29.734770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:29.735408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:29.735695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:29.735972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:29.745777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050933d9-d338-42f0-82f9-34ec866895fd None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:29.746098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050933d9-d338-42f0-82f9-34ec866895fd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:29.746365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050933d9-d338-42f0-82f9-34ec866895fd None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:29.747863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 271/546] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:15:29.753100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6306-3b54-456c-8013-822d92971861 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:29.753610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6306-3b54-456c-8013-822d92971861 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:29.754364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d6306-3b54-456c-8013-822d92971861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:29.758569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:29.760133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:29.774376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-744d6306-3b54-456c-8013-822d92971861 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:29.776015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-744d6306-3b54-456c-8013-822d92971861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:29.781294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:29.782271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:29.783549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:29.783549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:29.783549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:29.783549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 276/547] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:29.788291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:29.858256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 272/548] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:29.981808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3c7a-a342-4090-926d-910e2129b5c2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:30.024379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:30.025068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.025351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.025627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.026298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:30.026605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:30.027977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:30.029418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:30.048928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 277/549] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:30.063091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6306-3b54-456c-8013-822d92971861 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:30.109898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:30.171906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:30.226309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d6306-3b54-456c-8013-822d92971861 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:30.283884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fa6f4-89ef-41e3-962d-6772b0f09157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:30.284931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa6f4-89ef-41e3-962d-6772b0f09157 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.286220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa6f4-89ef-41e3-962d-6772b0f09157 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.286866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa6f4-89ef-41e3-962d-6772b0f09157 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.300588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fa6f4-89ef-41e3-962d-6772b0f09157 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:30.303456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fa6f4-89ef-41e3-962d-6772b0f09157 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-8d9fa6f4-89ef-41e3-962d-6772b0f09157 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:30.331172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:30.332405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:30.333365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 273/550] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:30.333954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4481-838f-4b19-9c58-ca815d811367 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.334535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4481-838f-4b19-9c58-ca815d811367 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.334535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4481-838f-4b19-9c58-ca815d811367 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.340244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 274/551] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:30.341404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b18e4-d600-4dc5-b1ec-95ca10c01b8a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.341695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b18e4-d600-4dc5-b1ec-95ca10c01b8a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.341970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b18e4-d600-4dc5-b1ec-95ca10c01b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.364303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e47b18e4-d600-4dc5-b1ec-95ca10c01b8a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:30.365539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e47b18e4-d600-4dc5-b1ec-95ca10c01b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:30.375882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24c3bb-6bb1-4e9b-a3eb-20b9f3fc3fe6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:30.419751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:30.420400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.420703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.420981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.432914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:30.438540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:30.439641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:30.440473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 278/552] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:30.441204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:30.452101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 275/553] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:30.453631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b18e4-d600-4dc5-b1ec-95ca10c01b8a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:30.474091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:30.532766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:30.620154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518ac64-d337-4ccc-851f-12e740c04baa None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:30.657479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:30.658471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.658951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.659419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.660363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:30.660883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:30.662530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:30.683988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 279/554] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 30 19:15:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:30.688437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b18e4-d600-4dc5-b1ec-95ca10c01b8a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:30.690353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:30.733813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69007fec-f44b-432c-94a7-460076184f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:30.734886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007fec-f44b-432c-94a7-460076184f6b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.735167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007fec-f44b-432c-94a7-460076184f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.735444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69007fec-f44b-432c-94a7-460076184f6b None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.736114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007fec-f44b-432c-94a7-460076184f6b None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:30.736771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007fec-f44b-432c-94a7-460076184f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:30.738626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69007fec-f44b-432c-94a7-460076184f6b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:30.753962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 276/555] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:30.755644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb70e3-ba87-4f0a-8f2d-2d4ccc6d889a None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.756043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb70e3-ba87-4f0a-8f2d-2d4ccc6d889a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.756320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb70e3-ba87-4f0a-8f2d-2d4ccc6d889a None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.757726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 277/556] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:30.758686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb70e3-ba87-4f0a-8f2d-2d4ccc6d889a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:30.799445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e938321-780b-4ee5-ac15-5e3f913934ad None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:30.814740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:30.837496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:30.838102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.838384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.838647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.852081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:30.874671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb70e3-ba87-4f0a-8f2d-2d4ccc6d889a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:30.909995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4735782-7539-428f-ba90-895297e4264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:30.910646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735782-7539-428f-ba90-895297e4264d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.910925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735782-7539-428f-ba90-895297e4264d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.911193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4735782-7539-428f-ba90-895297e4264d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.912756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:30.914297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:30.923404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735782-7539-428f-ba90-895297e4264d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:30.924867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4735782-7539-428f-ba90-895297e4264d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b4735782-7539-428f-ba90-895297e4264d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:30.940969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:30.941921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:30.943529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:30.943529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:30.943529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:30.943529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 278/557] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:30.943529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6b31a-060e-4b9e-b067-5ae188b56be0 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:30.943529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6b31a-060e-4b9e-b067-5ae188b56be0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:30.943956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6b31a-060e-4b9e-b067-5ae188b56be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:30.962548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2cf6b31a-060e-4b9e-b067-5ae188b56be0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:30.963781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2cf6b31a-060e-4b9e-b067-5ae188b56be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:31.030752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 280/558] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:31.031573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.036558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 279/559] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:31.046989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6b31a-060e-4b9e-b067-5ae188b56be0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.048764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.121516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.160607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6b31a-060e-4b9e-b067-5ae188b56be0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.164293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565c6f4-30b3-4554-ac88-0bcd1aa6da38 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.203353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.203964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.204293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.204562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.204972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.205236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:31.205539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.206233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.206714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.206950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.207374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.218649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:31.220535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:31.221425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:31.225985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:31.227622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:31.228515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:31.231736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:31.232831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.320458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.339430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96600a-11bf-4a8b-bc99-2f1265ff9007 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.354570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b08c3-fd71-4e03-a443-0c34485c245c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.363877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.379494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.380336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.380829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.381299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.389257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.389883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.390187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.390455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.393549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.395230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.397411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.400690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:31.410731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:31.411847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:31.412782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:31.412782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:31.412782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:31.412969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:31.413900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:31.415443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:31.416012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:31.416012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.418815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:31.419535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.524858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7ae8e-ff3c-42f3-a44b-8bcc274291c0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.531745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dae4-e842-4fa4-8061-bfdb44d0a8d4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.558252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.563615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.564347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.564625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.564895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.567265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.568138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.568415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.568687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.569342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:31.569796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.571553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.575341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:31.584501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:31.584695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:31.585601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:31.587888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:31.588545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.588621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:31.588621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.629971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.699425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fb897-f163-4ae0-b1cf-98878bfeccb3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.702944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a6415-5b6e-4201-b9e0-3a0a44b69590 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.734260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.734858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.735136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.735405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.736133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:31.736438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.737423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.737876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.738019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.738320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.738588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.739209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:31.739507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.740873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.752169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:31.752947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.757233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:31.758140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.809246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.845829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:31.852954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53be9e-6ade-4540-a2c6-1f492155e4e7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.860377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f220ef-0dbe-4382-b6c1-29b99467e9c2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:31.893555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.895312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.895312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.895312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.898509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f8a27-32df-46d3-ae88-fec8a381adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:31.899615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f8a27-32df-46d3-ae88-fec8a381adc5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.899976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f8a27-32df-46d3-ae88-fec8a381adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.900277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f8a27-32df-46d3-ae88-fec8a381adc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.900945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f8a27-32df-46d3-ae88-fec8a381adc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:31.901248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f8a27-32df-46d3-ae88-fec8a381adc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.902645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f8a27-32df-46d3-ae88-fec8a381adc5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.905815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:31.907344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:31.910494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 285/568] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:31.911655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2d07a-2100-4edb-9915-0f1e1bf58dff None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:31.911943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2d07a-2100-4edb-9915-0f1e1bf58dff None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:31.912220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2d07a-2100-4edb-9915-0f1e1bf58dff None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:31.914566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 286/569] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:31.914746 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2d07a-2100-4edb-9915-0f1e1bf58dff None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:31.922908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:31.924076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:31.925595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:31.925595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:31.925595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:31.925595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 284/570] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:31.925595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.016202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2d07a-2100-4edb-9915-0f1e1bf58dff None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.022572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9a8aa-1472-4f79-999f-bed038cc9de4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.029348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.051229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.051850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.052139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.052421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.059754 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.061175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58dc61-8303-4b02-a263-acce13d372f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.061288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.061809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58dc61-8303-4b02-a263-acce13d372f2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.062117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58dc61-8303-4b02-a263-acce13d372f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.062398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58dc61-8303-4b02-a263-acce13d372f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.073987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58dc61-8303-4b02-a263-acce13d372f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:32.074172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:32.075197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:32.076271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:32.076806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58dc61-8303-4b02-a263-acce13d372f2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.076877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 287/571] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:32.076877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.088975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-7d58dc61-8303-4b02-a263-acce13d372f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:32.095583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:32.096567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:32.097519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:32.097519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:32.097519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:32.097519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 285/572] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:32.098292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341239-6f64-4311-8774-4408e03aae2a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.098581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341239-6f64-4311-8774-4408e03aae2a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.099002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76341239-6f64-4311-8774-4408e03aae2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.116187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-76341239-6f64-4311-8774-4408e03aae2a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:32.117495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-76341239-6f64-4311-8774-4408e03aae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:32.187636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 286/573] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:32.188764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76341239-6f64-4311-8774-4408e03aae2a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.196829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b6c5d-873b-481c-8123-6bf2df787fc1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.232257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.232880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.233157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.233423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.244812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.246265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:32.261100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:32.266857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:32.268037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:32.268037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:32.268037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:32.268037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:32.268037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.291470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.314215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76341239-6f64-4311-8774-4408e03aae2a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.346709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.353912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.354616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.354973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.355316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.356014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:32.356377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.357813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.373706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:32.373706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.378083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9bffa-85a0-4c7e-a3ec-c6dfed1907a7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.414028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.414910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.415293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.415670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.416474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:32.416887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.418441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.431535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 289/576] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:32.437161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.479669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655045c-23b1-4837-b85e-adfdf8eb0da5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.518663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.519191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.519468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.519738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.520367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:32.520667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.522084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.531382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.534498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 288/577] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:32.535304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.549195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f1f94-ad94-4b2f-b580-5baa5aaf4726 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.582412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.583007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.583282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.583547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.584187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:32.584485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.585840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.587148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.597568 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 290/578] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:32.598392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.641536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f32f9-4d95-4c3a-91f8-e765cef2986c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.679362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.681133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.681404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.681673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.688677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.690135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.701417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615de961-e5ec-4e9a-ba5a-7c56c796f1ea None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:32.701890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:32.703007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:15:32.703972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:32.706323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 289/579] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:32.707080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.736150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.736738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.737020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.737291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.738013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=2975430fac884ff89b88b9fe1b76cb30) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:32.738353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.739766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.745503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/role_assignments?user.id=2975430fac884ff89b88b9fe1b76cb30&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:32.746299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.769464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.824295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306750-1883-4860-a599-bf4474718c93 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.840855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:32.867791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.868436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.868715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.868994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.880702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:32.883962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4a53-c22a-4dc2-ab70-041c54b43709 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:32.886742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:32.887751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 290/581] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:32.888715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:32.927190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:32.928253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:32.928539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:32.929789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:32.940341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:32.941801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:32.955898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:32.956853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:32.957745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:32.962218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 292/582] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:32.963286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.000517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69945f-771b-4221-b001-b52864b8ca88 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.040874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.041057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.041582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.041920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.042292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.050442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.055235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:33.068018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:33.069185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 19:15:33.071080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:33.072161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 291/583] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:33.072760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.089223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255be0be-7d1e-4cef-9195-126a9c459dc2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.104911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.132043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.132951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.133362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.133735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.134597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:33.135000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.136522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.160159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 293/584] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 30 19:15:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:33.161023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.202699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4fc36-0e05-4d25-ae87-09dbdea94482 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.237626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.238259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.238542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.238819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.239496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:33.239799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.241177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.249788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 292/585] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:33.250643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.284687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2c02-563a-485d-909a-274e69169523 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.312180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.322948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.323558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.323885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.324164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.324859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:33.325168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.326633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.338916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:33.340700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.352022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.363531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5b4-8eae-4684-873f-42dabe04c72c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.400102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.400885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.401278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.401651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.402517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:33.402903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.404438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.423377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 293/587] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:33.424195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.462797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fde2a6-9f17-4851-bc54-becd067dbbd7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.499911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.500660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.501363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.501647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.513414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.519251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:33.535677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:33.536679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:33.537604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:33.537604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:33.537604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:33.537604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:33.537604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.545677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ed243-7cae-4e93-aa82-a66771f49da7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.581724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.582630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.583269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.583555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.583830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.595250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.596742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:33.612325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:33.613389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:33.614920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:33.614920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:33.614920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:33.614920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:33.614920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.620716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.655785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d44cd9-457e-4c5c-ada2-03dcbeff7ce7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.694832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.696032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.696314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.696587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/57667fb21646457b8871087abcbd978c/roles/4da09e30141c409e82711c6915ca3cf1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.713826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=57667fb21646457b8871087abcbd978c, role_id=4da09e30141c409e82711c6915ca3cf1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.715309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.726066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491dc2e-8605-48fa-9349-231d3528e8c4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.730565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 296/590] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:15:33 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/57667fb21646457b8871087abcbd978c/roles/4da09e30141c409e82711c6915ca3cf1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:33.734938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.797743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.798823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.799291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.799753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.822618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.826083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:33.857471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:33.859329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:33.861982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:33.861982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:33.861982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:33.861982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 295/591] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:33.861982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:33.908183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.931986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383fc0b-b55b-4f22-9845-494cea9c35b2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:33.954596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:33.974476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:33.975410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:33.975895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:33.976411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:33.977297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:33.977843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:33.979473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:33.993584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 297/592] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:33.994849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.013162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75507530-366d-4cf8-be16-f7a75f7d2112 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.060454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.061335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.061879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.062379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.063213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:34.063707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.065286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.078517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 296/593] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:34.083252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.113351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bef819-055e-4fa7-bafc-d82370daea7b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.155082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.155695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.155976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.156249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.156898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:34.157265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.158588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.175429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 298/594] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:34.176295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.189730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:34.198256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474e4e8-e72b-44dc-8191-a9a6a5d70d66 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.213136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:34.236246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.237272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.237745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.238272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.245355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.247066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:34.260154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:34.261068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:34.261997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:34.264412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 297/595] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:34.265481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.302003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b2f56e-666c-4e60-8f81-378c0f399c89 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.341950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.343058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.343555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.344018 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.354006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.356467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:34.371253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:34.372201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 19:15:34.373151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:34.380666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 299/596] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:34.380666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.409901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a3550-f39a-4e10-aebc-1e0f25f284ae None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.448872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.450024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.450524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.451143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.458926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.460777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.462170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:34.475788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:34.476804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:34.477786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:34.480372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 298/597] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:34.481497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.500420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddce82-83be-4c9e-8036-a132c9e8f504 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.534887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:34.546868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.547755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.548618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.549319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.550204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:34.550756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.552538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.574265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 300/598] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:34.575080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.616214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2db9-5440-4923-bb2e-aa4d19a4de7f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.654338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.655286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.655789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.656266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.657236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:34.657810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.659465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.680890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 299/599] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Sep 30 19:15:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:34.682275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.698719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b51180-a1bf-4161-9e75-4af39d11430c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.733318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:34.741706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.744272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.744878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.745517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.746357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:34.746769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.748742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.763055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 301/600] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:34.764170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.796540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:34.808821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d006e-027d-4f32-9ccc-9957f29b5a57 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.852916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.854085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.854557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.855045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/d267807215f54e2ea4c91383b178ee25/roles/4da09e30141c409e82711c6915ca3cf1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.873385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=d267807215f54e2ea4c91383b178ee25, role_id=4da09e30141c409e82711c6915ca3cf1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.875180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.883635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54384d-9366-4932-9c97-d0d1cbf17a95 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:34.898947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 300/601] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:15:34 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/d267807215f54e2ea4c91383b178ee25/roles/4da09e30141c409e82711c6915ca3cf1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:34.900419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:34.923880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba12ff-9b68-45b6-8027-ec808d0cde7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:34.924574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba12ff-9b68-45b6-8027-ec808d0cde7a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.924891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba12ff-9b68-45b6-8027-ec808d0cde7a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.925221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba12ff-9b68-45b6-8027-ec808d0cde7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.938538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba12ff-9b68-45b6-8027-ec808d0cde7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:34.940166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba12ff-9b68-45b6-8027-ec808d0cde7a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-89ba12ff-9b68-45b6-8027-ec808d0cde7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:34.957761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:34.958813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:34.960219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:34.960219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:34.960219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:34.960430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 302/602] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:34.962430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d428-bd77-49f4-8a2a-93368385abbe None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.962715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d428-bd77-49f4-8a2a-93368385abbe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.962988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536d428-bd77-49f4-8a2a-93368385abbe None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.964658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 303/603] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:34.971562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7bd5-6732-402c-bca4-f88fa73a6d75 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:34.971901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7bd5-6732-402c-bca4-f88fa73a6d75 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:34.972103 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec7bd5-6732-402c-bca4-f88fa73a6d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:34.991804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-afec7bd5-6732-402c-bca4-f88fa73a6d75 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:34.994443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-afec7bd5-6732-402c-bca4-f88fa73a6d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:35.048626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:35.065961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b30496-d3fd-4987-8e05-a48d14ad7eba None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:35.093457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 304/604] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:35.094599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7bd5-6732-402c-bca4-f88fa73a6d75 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:35.120429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:35.121408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:35.121853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:35.122287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/9f5190ae783a4c89b51797729aaaa6ff/roles/4da09e30141c409e82711c6915ca3cf1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:35.141918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:35.145744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=9f5190ae783a4c89b51797729aaaa6ff, role_id=4da09e30141c409e82711c6915ca3cf1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:35.147399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:35.170176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 301/605] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:15:34 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/9f5190ae783a4c89b51797729aaaa6ff/roles/4da09e30141c409e82711c6915ca3cf1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:35.228998 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec7bd5-6732-402c-bca4-f88fa73a6d75 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:35.269756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:35.270775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:35.271248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:35.271737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:35.272572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:35.273066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:35.275456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:35.288308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 305/606] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:35.295008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:35.420961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00e524-163b-4590-8faa-bbc81115e3c4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:35.456735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:35.457371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:35.457653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:35.457928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:35.465513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:35.474370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:35.476160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:35.494535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:35.495630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:35.496723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:35.504563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 302/607] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:35.513813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:35.528595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:35.607848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c36c5-9316-4fbf-92af-ae72d36a5e1e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:35.611807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:35.647877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:35.648971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:35.649540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:35.650029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:35.661242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:35.668362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:35.669367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:35.670476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:35.673213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 306/608] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:35.679010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:35.748040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c4caa-b012-4b87-8413-f98256023752 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:35.782445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:35.790681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5db17-211e-4bd0-9f17-81094d2e0da6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:35.829020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:35.830487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:35.830994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:35.831474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:35.832364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:35.832888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:35.834517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:35.844443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 307/609] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:35.849544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:35.879136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:35.879766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:35.880046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:35.880320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:35.881020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:35.881342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:35.883558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:35.912301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 303/610] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:35.920569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:35.965992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f51f6-f3fd-404a-8dcf-1b7a98e0cfec None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:36.003537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:36.004922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.005771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.006376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.018218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:36.020410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:36.037597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:36.038679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:36.039752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:36.039752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:36.039752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:36.042379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 308/611] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:36.055867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:36.082452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:36.170016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767b5ee-a7e4-4494-a7eb-7b159fa0c644 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:36.189603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:36.218665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e962f9-69fe-4660-8b84-109da77ad68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:36.218895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47209e3-c4f4-4c86-a750-eae415db5725 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:36.219441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e962f9-69fe-4660-8b84-109da77ad68d None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.219810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e962f9-69fe-4660-8b84-109da77ad68d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.220403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e962f9-69fe-4660-8b84-109da77ad68d None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/38287d3f91704657bc26c5b4d50c0315/roles/4da09e30141c409e82711c6915ca3cf1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.240525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e962f9-69fe-4660-8b84-109da77ad68d None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=38287d3f91704657bc26c5b4d50c0315, role_id=4da09e30141c409e82711c6915ca3cf1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:36.243462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e962f9-69fe-4660-8b84-109da77ad68d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:36.255735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:36.256412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.256692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.257113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.257823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:36.258154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:36.259530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:36.263046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 304/612] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:15:35 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/38287d3f91704657bc26c5b4d50c0315/roles/4da09e30141c409e82711c6915ca3cf1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:36.271811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e0c32-017c-4e63-b2e5-6f60421c2be3 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.272149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e0c32-017c-4e63-b2e5-6f60421c2be3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.274536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e0c32-017c-4e63-b2e5-6f60421c2be3 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.278858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 305/613] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:36 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:36.285286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 309/614] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:36.286932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04c49-0b9c-4fc5-b35e-87d53e60f164 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.287215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04c49-0b9c-4fc5-b35e-87d53e60f164 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.287491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc04c49-0b9c-4fc5-b35e-87d53e60f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.291454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:36.339263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2fc04c49-0b9c-4fc5-b35e-87d53e60f164 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:36.340895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2fc04c49-0b9c-4fc5-b35e-87d53e60f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:36.378513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:36.412524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc2fbc-28e3-466a-83cd-d6ab76b42e88 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:36.457982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:36.458873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.459158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.459429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.467645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:36.469269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:36.482788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:36.483827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:36.485135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 310/615] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:36.489272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:36.519762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 306/616] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:36.606006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185a10e-16ae-4962-ad2d-bc864e374d7b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:36.630606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:36.642485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:36.643409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.644095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.644373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.645106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:36.645415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:36.646923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:36.665772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 311/617] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 30 19:15:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:36.671429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04c49-0b9c-4fc5-b35e-87d53e60f164 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:36.808542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:36.823254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc04c49-0b9c-4fc5-b35e-87d53e60f164 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:36.848907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:36.880528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:36.881850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:36.882463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:36.883356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:36.905347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:36.907319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:36.935233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:36.936264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:36.937179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:36.937179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:36.937179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:36.937179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 307/618] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:36.945086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.033717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe8369-bace-460a-a579-5c2ae6cdc003 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.070462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:37.071279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.071720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.072091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.082917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:37.088302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:37.089602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:37.090489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:37.091172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 312/619] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:37.097296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.158404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfc9c1-3858-4592-aa1c-9186bb2ac8b8 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.180334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:37.228512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:37.229132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.229415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.229687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.230359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:37.230666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:37.232051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:37.256889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 308/620] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:37.262007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.267157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:37.275028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b3d27-51ba-4e9d-8a55-025ad819bcb5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.311501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:37.312119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.312406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.312683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.313358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:37.313668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:37.315076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:37.323781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 313/621] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:37.339123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.404318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056dd78-6997-4510-8d28-601d177eb319 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.441244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:37.441879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.442189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.442465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.450719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:37.452708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:37.467028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:37.468000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:37.468961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 309/622] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:37.477760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.525640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828d25a-8daf-49ea-bd0c-008a19fe8cc9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.546489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:37.558682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:37.585165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d8ba0-d6fa-4f4a-84e1-c221b13eb28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:37.588784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8ba0-d6fa-4f4a-84e1-c221b13eb28f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.588784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8ba0-d6fa-4f4a-84e1-c221b13eb28f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.588784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8ba0-d6fa-4f4a-84e1-c221b13eb28f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.600350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d8ba0-d6fa-4f4a-84e1-c221b13eb28f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:37.600970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef85f9c-3f17-4303-80c6-c6171af2bf97 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.602437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d8ba0-d6fa-4f4a-84e1-c221b13eb28f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-104d8ba0-d6fa-4f4a-84e1-c221b13eb28f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:37.619082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:37.620074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:37.620993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:37.620993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:37.620993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:37.623312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 314/623] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:37.624671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d48a-8d99-449b-a3de-4ea148bfe506 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.625041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d48a-8d99-449b-a3de-4ea148bfe506 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.625388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548d48a-8d99-449b-a3de-4ea148bfe506 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.626984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 315/624] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:37.628539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d48a-8d99-449b-a3de-4ea148bfe506 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.641978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ade6e3-2519-4c18-a6b6-3b0e57f104ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:37.642634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade6e3-2519-4c18-a6b6-3b0e57f104ed None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.642914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade6e3-2519-4c18-a6b6-3b0e57f104ed None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.643186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ade6e3-2519-4c18-a6b6-3b0e57f104ed None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.643876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ade6e3-2519-4c18-a6b6-3b0e57f104ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:37.644177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ade6e3-2519-4c18-a6b6-3b0e57f104ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:37.645627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ade6e3-2519-4c18-a6b6-3b0e57f104ed None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:37.658490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 310/625] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:37.659807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ce10-a8c7-43b4-831f-fd274af16176 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.660097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ce10-a8c7-43b4-831f-fd274af16176 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.660373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ce10-a8c7-43b4-831f-fd274af16176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.680223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ea80ce10-a8c7-43b4-831f-fd274af16176 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:37.681463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ea80ce10-a8c7-43b4-831f-fd274af16176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:37.751501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548d48a-8d99-449b-a3de-4ea148bfe506 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.757652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 311/626] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:37.758591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80ce10-a8c7-43b4-831f-fd274af16176 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.814046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:37.814674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:37.814954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:37.815227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:37.815873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:37.816758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:37.818355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:37.851808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 316/627] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:37.859591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:37.863916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:37.890888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:37.954324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80ce10-a8c7-43b4-831f-fd274af16176 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:37.999483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d1057-0bcd-42a3-b3b9-9429929e2c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.000544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d1057-0bcd-42a3-b3b9-9429929e2c54 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.000831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d1057-0bcd-42a3-b3b9-9429929e2c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.001111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d1057-0bcd-42a3-b3b9-9429929e2c54 None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/2975430fac884ff89b88b9fe1b76cb30/roles/4da09e30141c409e82711c6915ca3cf1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.018422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d740e4-4a79-4810-95c3-b3acd0269b6f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.021998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d1057-0bcd-42a3-b3b9-9429929e2c54 None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=2975430fac884ff89b88b9fe1b76cb30, role_id=4da09e30141c409e82711c6915ca3cf1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:38.023636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d1057-0bcd-42a3-b3b9-9429929e2c54 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:38.040450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 312/628] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:15:37 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/2975430fac884ff89b88b9fe1b76cb30/roles/4da09e30141c409e82711c6915ca3cf1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:38.041844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5151075-84de-40f1-adfe-0d889bf3fac6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.042181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5151075-84de-40f1-adfe-0d889bf3fac6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.043071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5151075-84de-40f1-adfe-0d889bf3fac6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.048497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 313/629] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:38.048497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5151075-84de-40f1-adfe-0d889bf3fac6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.077392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a9a69-bdef-4d2f-ab98-ee9241e79808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.078067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9a69-bdef-4d2f-ab98-ee9241e79808 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.078347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9a69-bdef-4d2f-ab98-ee9241e79808 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.078615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a9a69-bdef-4d2f-ab98-ee9241e79808 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.091043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a9a69-bdef-4d2f-ab98-ee9241e79808 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:38.092507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a9a69-bdef-4d2f-ab98-ee9241e79808 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-8b2a9a69-bdef-4d2f-ab98-ee9241e79808 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:38.106876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:38.107929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:38.109244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:38.113491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 317/630] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:15:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:38.114394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae47a86-82b6-46a7-aa94-cc3231fb3fb2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.114681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae47a86-82b6-46a7-aa94-cc3231fb3fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.114953 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae47a86-82b6-46a7-aa94-cc3231fb3fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.136301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7ae47a86-82b6-46a7-aa94-cc3231fb3fb2 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:38.137568 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7ae47a86-82b6-46a7-aa94-cc3231fb3fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:38.198303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5151075-84de-40f1-adfe-0d889bf3fac6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.201842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:38.235246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 318/631] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:38.236405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae47a86-82b6-46a7-aa94-cc3231fb3fb2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.245970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:38.251685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.252595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.253096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.253559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.265639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:38.271260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:38.272187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:38.273642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:38.276525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 314/632] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:38.282554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.352894 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae47a86-82b6-46a7-aa94-cc3231fb3fb2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.394180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.394180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.394180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.394180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.394580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:38.394580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:38.394580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:38.408878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045500d-d601-4196-a276-73b4f2beaea5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.412825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 319/633] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:38.426102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.471914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.472917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.473495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.473970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.474945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:38.475443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:38.477652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:38.488062 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:38.499946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 315/634] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:38.506986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.530337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35425bb6-8ae2-4c11-a574-977a275f73ad None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.561072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:38.573070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.573931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.574395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.574813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.657716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6397cab-764f-4ce4-b114-9c1e52a051d5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.662495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:38.664666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:38.705891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.706563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.706845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.707117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.721891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:38.723397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:38.736621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:38.745364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:38.746446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:38.747982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:38.747982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:38.747982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:38.747982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 316/635] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:38.747982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.794465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 320/636] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:15:38.795711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.857946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:38.883082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cc29f-0789-406f-ac88-562d946dbc6e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.907364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b51d0-4d92-4526-b5fc-445777943e1e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:38.924648 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.925597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.925597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.925903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.939455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:38.947508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:38.948532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 317/637] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:38.950180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:38.952468 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:38.953363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:38.953834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:38.954332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:38.955207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:38.955798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:38.957366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:38.970559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 321/638] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:38.971801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.001845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.080381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ee48b-6c10-4d7e-89e9-c4ce6e258859 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.094189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee68b3-c567-442a-a839-a68264524d90 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.115616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.116258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.116537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.116851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.125258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.130814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.132325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.140853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9729-d445-409a-8365-1df36eedf198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.141856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9729-d445-409a-8365-1df36eedf198 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.142168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9729-d445-409a-8365-1df36eedf198 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.142594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9729-d445-409a-8365-1df36eedf198 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.143452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9729-d445-409a-8365-1df36eedf198 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:39.143760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9729-d445-409a-8365-1df36eedf198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.145110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9729-d445-409a-8365-1df36eedf198 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:39.147739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:39.149310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:39.155255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:39.155255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:39.155255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:39.155255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 318/639] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:39.155255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.162566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 322/640] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:39.165155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab757d-587f-430a-9625-c286511414b7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.165440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab757d-587f-430a-9625-c286511414b7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.165714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab757d-587f-430a-9625-c286511414b7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.167125 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 323/641] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:39.167725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab757d-587f-430a-9625-c286511414b7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.256169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.270794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd8640-6af9-48b8-9d86-051c042ff63f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.271951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab757d-587f-430a-9625-c286511414b7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.307557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.308166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.308441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.308715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.309408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:39.309658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.310652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b70f94-98d7-4fd7-83f7-aff7fd2f604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.311042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.311272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b70f94-98d7-4fd7-83f7-aff7fd2f604e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.311548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b70f94-98d7-4fd7-83f7-aff7fd2f604e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.311818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b70f94-98d7-4fd7-83f7-aff7fd2f604e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.320672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b70f94-98d7-4fd7-83f7-aff7fd2f604e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.322167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b70f94-98d7-4fd7-83f7-aff7fd2f604e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.328655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 324/642] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:39.328655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-66b70f94-98d7-4fd7-83f7-aff7fd2f604e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:39.338720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:39.339771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:39.340785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 319/643] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:39.341417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7983c-0388-4a8d-aa7d-af87c883bd95 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.341417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7983c-0388-4a8d-aa7d-af87c883bd95 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.342386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7983c-0388-4a8d-aa7d-af87c883bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.360910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a3f7983c-0388-4a8d-aa7d-af87c883bd95 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:39.362280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a3f7983c-0388-4a8d-aa7d-af87c883bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:39.412133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.438224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 320/644] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:39.439270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7983c-0388-4a8d-aa7d-af87c883bd95 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.439883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bfe51-f608-40b6-83b3-09c2568fd0d8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.493339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.494483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.495009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.495906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.509845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.511438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.519188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:39.528771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:39.530001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:39.531364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:39.531364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:39.531364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:39.536592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 325/645] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:39.537551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.564887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7983c-0388-4a8d-aa7d-af87c883bd95 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.600354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.601714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.602164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.602619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.609677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.611541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:39.623067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:39.624170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:39.625329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:39.626989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 321/646] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:39.627902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.675326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.683155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418128fe-46a1-494e-a6ef-178560309bfd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.731358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.731973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.732255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.732530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.733254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:39.733561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.735021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.737846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07603949-a1fa-42d6-b50a-335cd2b03ddb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.754195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 326/647] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:39.755461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.775068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.775880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.776147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.776569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.777213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:39.777788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.779187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.796219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 322/648] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:39.796219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.822216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.873608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119eb579-5e86-4b68-8fe3-5b949c954999 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.893108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:39.896601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f70d-8245-4f11-a395-649010f5a2e4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:39.912826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.914139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.914575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.914876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.915569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:39.916048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:39.917777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:39.931214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 327/649] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:39.932704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:39.935767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:39.936471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:39.936844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:39.937187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:39.948770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:39.954135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:39.955302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:39.956393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:39.957639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 323/650] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:39.958408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.049526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd9dab-6b3e-40bd-9db4-c40164680390 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.067880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb5a70-953f-450a-b177-0a60737487f0 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.078238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.097616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.098458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.098840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.099223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.110448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.111073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.111638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.111920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.120107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.121594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:40.134652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:40.135849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 30 19:15:40.137027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:40.140238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 324/651] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:40.141136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.162535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.178094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.179640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.246638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030dddf2-dbcf-41ea-b571-87ba4191f550 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.282179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.282800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.283076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.283347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.284088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=57667fb21646457b8871087abcbd978c) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:40.284398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.290507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 328/652] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:40.290732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.290844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.296365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 325/653] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/role_assignments?user.id=57667fb21646457b8871087abcbd978c&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:40.299047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.314319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.416480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.427262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf00c52-68cf-4901-9130-fd33ae48db33 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.435667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3394c2-cf07-45bd-a5e0-ec3188c7ecea None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.464171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.464788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.465062 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.465323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.465986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:40.466315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.467697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.482506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 329/654] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:40.482506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.485190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4525c05-caa5-46b4-b4fd-a497966dae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.485886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525c05-caa5-46b4-b4fd-a497966dae43 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.486223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525c05-caa5-46b4-b4fd-a497966dae43 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.486502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525c05-caa5-46b4-b4fd-a497966dae43 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.487261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4525c05-caa5-46b4-b4fd-a497966dae43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:40.487573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4525c05-caa5-46b4-b4fd-a497966dae43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.489017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4525c05-caa5-46b4-b4fd-a497966dae43 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.511068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 326/655] 10.222.0.18 () {56 vars in 1137 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:40.513961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a085-a27f-4120-82ff-d0ee9c1e5cfc None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.514984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a085-a27f-4120-82ff-d0ee9c1e5cfc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.514984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07a085-a27f-4120-82ff-d0ee9c1e5cfc None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.516338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 327/656] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:40.516816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a085-a27f-4120-82ff-d0ee9c1e5cfc None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.578264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.604380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d524a-44f4-4162-a935-78583b0c748c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.630590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07a085-a27f-4120-82ff-d0ee9c1e5cfc None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.641135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.642272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.642513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.642851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.654569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.656012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.667046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815d2da-ef77-40a8-81da-247a501bf11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.667918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d2da-ef77-40a8-81da-247a501bf11b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.668227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d2da-ef77-40a8-81da-247a501bf11b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.668487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d2da-ef77-40a8-81da-247a501bf11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:40.670880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:40.671833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:40.672793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:40.672793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:40.672793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:40.672793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 330/657] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:40.672793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.684680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815d2da-ef77-40a8-81da-247a501bf11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.686378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815d2da-ef77-40a8-81da-247a501bf11b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.688214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-5815d2da-ef77-40a8-81da-247a501bf11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:40.702169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:40.707949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:40.709147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:40.709147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:40.709147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:40.709147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 328/658] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:40.709147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779d0d-0ecf-4f6b-b84d-e208bc5a6bb4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.709147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779d0d-0ecf-4f6b-b84d-e208bc5a6bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.709147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a779d0d-0ecf-4f6b-b84d-e208bc5a6bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.725151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3a779d0d-0ecf-4f6b-b84d-e208bc5a6bb4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:40.726488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3a779d0d-0ecf-4f6b-b84d-e208bc5a6bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:40.791106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0525ae-630e-4407-9ae8-0f06debaad3c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.806080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 329/659] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:40.806080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a779d0d-0ecf-4f6b-b84d-e208bc5a6bb4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:40.830725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.842932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.844014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.844666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.845089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.922241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a779d0d-0ecf-4f6b-b84d-e208bc5a6bb4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:40.935992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.938934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.947985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:40.960542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:40.961466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:40.961842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:40.962236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:40.962967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:40.963361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:40.964882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:40.981778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 330/660] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:40.982837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.065702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 331/661] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:41.065702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.100658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.119677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aa7c7-5c5c-4ab4-b7fc-b223dceb41bf None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.154145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.154891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.155276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.155556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.156190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:41.156488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.157857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.170181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 331/662] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:41.171072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.183148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b210016-baa1-46fa-8961-d81f34cdbb52 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.221070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.222949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.223583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.223892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.224239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.231497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.232962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:41.244901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:41.246002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 332/663] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:41.247121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.290775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497d5a-f99c-4a78-a9be-9372e02782c9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.329913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.330569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.330849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.331117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.342175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.343664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.356352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:41.359942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:41.361185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:41.362288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:41.362288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:41.362288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:41.362288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 332/664] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:41.366129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.371283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a17d3-cdb3-491b-b35d-ebbbb9a282c1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.413124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.414879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.415154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.415423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.425496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:41.431400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:41.432436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 333/665] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:41.433436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.470311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.477162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300b840-6511-430d-897b-aa03a7b0cc56 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.512434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.513207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.513593 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.513967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.521773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.523912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:41.535312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:41.536469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:41.537442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 333/666] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:41.538080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.548414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da454c52-82db-4c4b-b05a-805e7f58bd54 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.584885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d85ce-f924-426a-9030-15b912225044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.586240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d85ce-f924-426a-9030-15b912225044 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.586589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d85ce-f924-426a-9030-15b912225044 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.586936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d85ce-f924-426a-9030-15b912225044 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.587706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d85ce-f924-426a-9030-15b912225044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:41.588087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d85ce-f924-426a-9030-15b912225044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.589593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d85ce-f924-426a-9030-15b912225044 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.602841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 334/667] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:41.603779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d85ce-f924-426a-9030-15b912225044 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.620569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.656863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cdcbe-8d0c-46ec-a13b-c7481e5aa119 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.693375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.693976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.694278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.695192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.695974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:41.696280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.697667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.713647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 334/668] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:41.713647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.722329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d85ce-f924-426a-9030-15b912225044 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.729640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.759086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.759688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.759964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.760259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.760888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:41.761187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.762573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.775325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 335/669] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:41.775325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.812350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44b26d-7f5f-4b8a-bee0-2d08fd031e92 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.845601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.846225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.846502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.846771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.847017 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.847476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:41.847922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.849243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.871985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 335/670] 10.222.0.18 () {56 vars in 1139 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:41.871985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.885698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970de44-4f57-4b0c-8e9e-0c2296152041 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:41.922546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:41.923334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:41.923610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:41.923931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:41.924651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=d267807215f54e2ea4c91383b178ee25) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:41.925193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:41.926384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:41.933034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 336/671] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/role_assignments?user.id=d267807215f54e2ea4c91383b178ee25&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:41.933799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:41.957373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:41.988091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fc633-ae3f-4f31-905f-0a75d9a57b1a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.032673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.033503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.033876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.034275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.044318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.046022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:42.067836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:42.068997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:42.070435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:42.073194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 336/672] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:42.074618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.088310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e13d4-b60b-4278-a7e8-ae36b694101e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.136613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.137171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.137446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.137720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.141028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:42.151066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.152668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:42.173442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:42.174652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:42.175544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:42.175544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:42.175544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:42.175544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 337/673] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:42.178247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.217060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a4af-c62a-4415-bed3-bf5552ca97d2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.263491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.264761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.265218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.265939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.269596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:42.290244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518569a-caa5-4814-9774-79c4d1240618 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.327034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.327767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.328113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.328458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.329310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:42.329685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.331428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.346338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 338/674] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:42.347282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.353051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.354786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.406503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:42.455368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc7038-878b-45ac-98a2-eb38b989a70a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.487660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 337/675] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:42.488790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.502765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.504108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.504305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.504672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.505440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:42.505850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.508008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.521195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 339/676] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:42.526409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.533193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:42.617035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414f52c-022d-4eaa-b09a-d2eb9b25a382 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.651449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e079cd0-2310-43ae-8446-fb187bd26971 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.653205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.653810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.654115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.654393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.655104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=9f5190ae783a4c89b51797729aaaa6ff) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:42.655406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.656893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.661036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:42.670294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 338/677] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/role_assignments?user.id=9f5190ae783a4c89b51797729aaaa6ff&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:42.671266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.692405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47bea-953d-405e-b7f7-82a0207d2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.693132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47bea-953d-405e-b7f7-82a0207d2258 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.693304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47bea-953d-405e-b7f7-82a0207d2258 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.693586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47bea-953d-405e-b7f7-82a0207d2258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.707624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47bea-953d-405e-b7f7-82a0207d2258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.709143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47bea-953d-405e-b7f7-82a0207d2258 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bfa47bea-953d-405e-b7f7-82a0207d2258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:42.730824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:42.731849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:42.732759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:42.732759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:42.732759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:42.736105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 340/678] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:42.737518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31b565-b0e4-49e8-8199-dedc89924650 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.737799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31b565-b0e4-49e8-8199-dedc89924650 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.738160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31b565-b0e4-49e8-8199-dedc89924650 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.739805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 341/679] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:42.740580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31b565-b0e4-49e8-8199-dedc89924650 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.811135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:42.815539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129afc8d-544d-4ca6-b9ef-ad9d284ff6a9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.855978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c52d06-9c17-4e8b-aa28-ffc6138c3771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.856613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52d06-9c17-4e8b-aa28-ffc6138c3771 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.856889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52d06-9c17-4e8b-aa28-ffc6138c3771 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.857157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c52d06-9c17-4e8b-aa28-ffc6138c3771 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.865787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c52d06-9c17-4e8b-aa28-ffc6138c3771 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.867943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c52d06-9c17-4e8b-aa28-ffc6138c3771 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-d8c52d06-9c17-4e8b-aa28-ffc6138c3771 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:42.879761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:42.880732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:42.881682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 339/680] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:42.883231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4167ef-01de-405c-8a7c-0009b21912d6 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.883231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4167ef-01de-405c-8a7c-0009b21912d6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.883231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4167ef-01de-405c-8a7c-0009b21912d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.900179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31b565-b0e4-49e8-8199-dedc89924650 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:42.906536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3e4167ef-01de-405c-8a7c-0009b21912d6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:42.907887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3e4167ef-01de-405c-8a7c-0009b21912d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:42.943071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:42.943830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:42.944117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:42.944664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:42.945548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:42.945822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:42.947692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:42.962943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 342/681] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:42.963796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:42.991989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 340/682] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:42.998559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:42.999068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4167ef-01de-405c-8a7c-0009b21912d6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.157467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877b3c-d7b4-42f1-a728-9c0498596c0f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.159113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:43.179056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4167ef-01de-405c-8a7c-0009b21912d6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.224580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.225185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.225460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.226274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.226997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:43.227298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.228723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.243519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.244149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.244424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.244691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.259600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.261059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.270609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 343/683] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:43.275820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:43.280509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:43.281449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:43.282376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:43.282837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 341/684] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:43.290119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.374465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:43.398817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31e409-3f01-4eb4-b915-5a9471db7d3f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.402748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78522e-9cd6-48fd-aae0-ac6792d433d2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.436221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.437321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.437805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.438385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.438907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.439507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.439782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.440049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.440847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:43.441149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.442636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.455534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 342/685] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:43.456567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.467651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:43.512748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.514536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.564582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fd7e4-2c55-4302-a15c-51189966c2bf None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.598199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:43.603442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.604164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.604358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.604668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.617743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:43.622986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:43.623948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:43.624819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 343/686] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:43.625544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.634178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 344/687] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:15:43.635404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.696033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:43.732726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47001-95ec-4c01-aeb2-21f4e5c194cb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.742734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7dec6-9c4f-4583-9960-727b02730575 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.779977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.781027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.781152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.781627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.781875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.782043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.782202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.782831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.782957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=38287d3f91704657bc26c5b4d50c0315) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:43.783248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.784044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:43.784554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.784730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.786297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.791939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 344/688] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/role_assignments?user.id=38287d3f91704657bc26c5b4d50c0315&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:43.792906 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.801955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 345/689] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:43.803550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.852493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:43.906857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6c5fe-2078-4b58-a92d-1064dbd9c2af None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.919888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7653eb5-df5e-44de-8ad2-79048e262f3d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:43.939324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:43.946890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.947697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.948116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.948527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.958974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:43.959738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:43.960202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:43.960702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:43.961438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.963186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.973506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:43.975133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:43.980357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:43.981312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:43.982383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:43.982383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:43.982383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:43.984148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 345/690] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:43.991929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:43.993019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:43.993993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:43.993993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:43.993993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:43.993993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 346/691] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:43.995615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:43.999099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.109619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:44.123200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f69f-eef9-44e9-99ff-57635c034315 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.174901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.176292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.176763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.177197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.178085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:44.178538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.180927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:44.195965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f3ce3-3d15-4d72-b55c-5334acebcdbe None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.197096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 347/692] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:44.202570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.236101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.236715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.236994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.237291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.237905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:44.238255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.239745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:44.254450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 346/693] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:44.260198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.312322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:44.321281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84bb63-3abb-4120-9e88-bfd8fbcdbdec None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.364761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0906873-5c93-4316-9b24-e6ad659e6563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.365769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0906873-5c93-4316-9b24-e6ad659e6563 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.366070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0906873-5c93-4316-9b24-e6ad659e6563 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.367152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0906873-5c93-4316-9b24-e6ad659e6563 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.371790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88657090-ba19-4316-87dc-d63cea9c542e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.381358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0906873-5c93-4316-9b24-e6ad659e6563 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.383501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0906873-5c93-4316-9b24-e6ad659e6563 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b0906873-5c93-4316-9b24-e6ad659e6563 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:44.396561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:44.397801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:44.399023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:44.406078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 348/694] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:15:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:44.406078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a15a-6420-4f50-8cda-c8f958e24c4b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.406078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a15a-6420-4f50-8cda-c8f958e24c4b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.406078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a15a-6420-4f50-8cda-c8f958e24c4b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.407912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 349/695] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:44.408849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a15a-6420-4f50-8cda-c8f958e24c4b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.421206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872889e-4fed-4053-8f8a-c85db2ec51d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.421930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872889e-4fed-4053-8f8a-c85db2ec51d2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.422303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872889e-4fed-4053-8f8a-c85db2ec51d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.422880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872889e-4fed-4053-8f8a-c85db2ec51d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.425292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:44.431031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872889e-4fed-4053-8f8a-c85db2ec51d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.432398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872889e-4fed-4053-8f8a-c85db2ec51d2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-8872889e-4fed-4053-8f8a-c85db2ec51d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:44.443835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:44.445638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 347/696] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319c925-056a-458b-b43f-92fafc972421 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.447576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319c925-056a-458b-b43f-92fafc972421 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.449171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319c925-056a-458b-b43f-92fafc972421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.465839 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4319c925-056a-458b-b43f-92fafc972421 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:44.467175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4319c925-056a-458b-b43f-92fafc972421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:44.524227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a15a-6420-4f50-8cda-c8f958e24c4b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.536818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 348/697] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:44.537659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319c925-056a-458b-b43f-92fafc972421 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.579117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:44.587655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.588274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.588555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.588827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.589555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:44.589957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.591512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:44.627476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 350/698] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:15:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:44.635554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.643096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319c925-056a-458b-b43f-92fafc972421 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.680043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.680658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.680932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.681203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.681887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:44.682213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.683643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:44.696581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 349/699] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:44.706027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.756170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:44.803240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2fe8-efba-48c3-805e-518f518f66e6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.869490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.870131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.870410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.870678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.892005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:44.903899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4b89d-5596-42de-a7a9-e2e336ada288 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:44.954626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:44.955423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:44.955712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:44.956371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:44.957332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=2975430fac884ff89b88b9fe1b76cb30) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:44.957645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.960040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:44.974948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:44.975121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 350/700] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:44 2022] GET /identity/v3/role_assignments?user.id=2975430fac884ff89b88b9fe1b76cb30&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:44.976114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:44.976765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.074736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:45.115131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 351/701] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 30 19:15:45.120850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:45.161653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bce832-30c0-4e22-b7f4-cad8dff99077 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:45.208384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:45.209276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.209758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.210909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.211764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:45.213297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:45.230534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:45.231896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:45.232956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:45.240009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 351/702] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Sep 30 19:15:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:45.241902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:45.269151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:45.281693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942764a1-2bc8-4e36-9ee6-1bf9231dc736 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:45.319613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:45.320392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.320768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.321129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.332282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:45.333930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:45.349496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:45.351235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:45.352164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:45.352164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:45.352164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:45.352476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 352/703] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:45.357485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:45.357829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e074293-f8b4-4e8f-9e21-48871d6561cb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:45.387669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:45.400474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:45.401432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.401914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.402379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.403189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:45.403672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:45.405235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.414156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 352/704] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 30 19:15:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:45.416971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:45.474521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ab4ac-1da2-41cf-ba24-520b1aba2d8d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:45.509072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:45.513680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad4cb0-44c2-4d58-86e7-e4367779a6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:45.514452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad4cb0-44c2-4d58-86e7-e4367779a6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.515014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad4cb0-44c2-4d58-86e7-e4367779a6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.515122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad4cb0-44c2-4d58-86e7-e4367779a6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.515737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad4cb0-44c2-4d58-86e7-e4367779a6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:45.516055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad4cb0-44c2-4d58-86e7-e4367779a6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:45.517421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad4cb0-44c2-4d58-86e7-e4367779a6f5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.526800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba5bdb-999f-4a73-80f8-1657e99bed1e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:45.534679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 353/705] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:45.535957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ebb3-a35e-410a-b5f0-31dfea49fd6b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.536248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ebb3-a35e-410a-b5f0-31dfea49fd6b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.536514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ebb3-a35e-410a-b5f0-31dfea49fd6b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.538527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 354/706] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:45.542513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ebb3-a35e-410a-b5f0-31dfea49fd6b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:45.572511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892a3c8-73d1-40e1-8b5d-ff2a15270e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:45.573606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a3c8-73d1-40e1-8b5d-ff2a15270e2a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.574332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a3c8-73d1-40e1-8b5d-ff2a15270e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.575029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892a3c8-73d1-40e1-8b5d-ff2a15270e2a None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.575807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a3c8-73d1-40e1-8b5d-ff2a15270e2a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:45.576367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a3c8-73d1-40e1-8b5d-ff2a15270e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:45.578539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892a3c8-73d1-40e1-8b5d-ff2a15270e2a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.586857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 353/707] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 30 19:15:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:45.588735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f79969-9d4a-423b-b436-054c6c17e13f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.589184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f79969-9d4a-423b-b436-054c6c17e13f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.589599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f79969-9d4a-423b-b436-054c6c17e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.623199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-80f79969-9d4a-423b-b436-054c6c17e13f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:45.624700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-80f79969-9d4a-423b-b436-054c6c17e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:45.641184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:45.664675 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ebb3-a35e-410a-b5f0-31dfea49fd6b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:45.706509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:45.707395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.707820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.708289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.716107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:45.717880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:45.751637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:45.752787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:45.754219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:45.756206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 355/708] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:45.762334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:45.797315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 354/709] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:45.873301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b4dbd-31f5-458a-9265-f5d6bdddf021 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:45.908676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:45.909282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:45.909553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:45.909825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:45.910529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:45.910829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:45.912236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:45.927861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 356/710] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:45.934199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f79969-9d4a-423b-b436-054c6c17e13f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:46.046126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:46.079791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f79969-9d4a-423b-b436-054c6c17e13f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:46.101586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:46.104594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:46.139742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:46.140358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:46.140636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:46.140904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:46.141628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=57667fb21646457b8871087abcbd978c) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:46.141932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:46.143394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:46.156270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 355/711] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:45 2022] GET /identity/v3/role_assignments?user.id=57667fb21646457b8871087abcbd978c&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:46.239697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639fbe03-89b8-4e1f-b202-05671fe05572 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:46.277889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:46.278653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:46.278930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:46.279196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:46.298128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:46.299671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:46.320442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:46.321493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:46.322510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:46.322510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:46.322510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:46.322510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 357/712] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:46.327854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:46.459236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99194c-e011-446f-906e-7e388f358eda None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:46.494714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4097-6f50-4373-bf9b-197a67f1d7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:46.495320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4097-6f50-4373-bf9b-197a67f1d7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:46.495591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4097-6f50-4373-bf9b-197a67f1d7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:46.495858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4097-6f50-4373-bf9b-197a67f1d7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:46.496488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4097-6f50-4373-bf9b-197a67f1d7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:46.496784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4097-6f50-4373-bf9b-197a67f1d7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:46.498181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4097-6f50-4373-bf9b-197a67f1d7a7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:46.511397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 356/713] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:46.519136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:46.525028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934473-c412-4b52-b087-cdfe1c34f6a9 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:46.525304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934473-c412-4b52-b087-cdfe1c34f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:46.525569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934473-c412-4b52-b087-cdfe1c34f6a9 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:46.526907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 357/714] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:46.534236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb27a0-23eb-49d8-b4bb-ce2ec820d959 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:46.534518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb27a0-23eb-49d8-b4bb-ce2ec820d959 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:46.534791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb27a0-23eb-49d8-b4bb-ce2ec820d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:46.547411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:46.567086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a1eb27a0-23eb-49d8-b4bb-ce2ec820d959 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:46.568197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a1eb27a0-23eb-49d8-b4bb-ce2ec820d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:46.620837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:46.702094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39f675-58b7-4649-bd19-0a778ee7aafe None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:46.710228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 358/715] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:46.757606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:46.758254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:46.758529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:46.758800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:46.759465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:46.760870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:46.788992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 358/716] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:15:46 2022] POST /identity/v3/users => generated 254 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:47.125709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb27a0-23eb-49d8-b4bb-ce2ec820d959 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:47.232421 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb27a0-23eb-49d8-b4bb-ce2ec820d959 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:47.268437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:47.269062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:47.269392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:47.269665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] PATH_INFO: `/v3/services/network` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:47.270294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:47.271655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:47.273919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:47.281547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:47.282661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:47.283550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 359/717] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:47 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:47.289306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:47.406042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78fb0-1e7a-4dde-aed9-c47bf962522f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:47.418747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:47.451858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aefc9c-df98-4240-83da-a62e0b8e0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:47.452493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aefc9c-df98-4240-83da-a62e0b8e0579 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:47.452817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aefc9c-df98-4240-83da-a62e0b8e0579 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:47.453091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aefc9c-df98-4240-83da-a62e0b8e0579 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:47.455080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aefc9c-df98-4240-83da-a62e0b8e0579 None admin] RBAC: Adding query filter params (name=network) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:47.455080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aefc9c-df98-4240-83da-a62e0b8e0579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:47.455422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aefc9c-df98-4240-83da-a62e0b8e0579 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:47.462202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 359/718] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:15:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:47.474067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:47.629845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1642cc0-8ab7-48bb-8030-3cb044f99586 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:47.673968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e9649-047b-4ec9-b7a8-cf00ce923e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:47.674538 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e9649-047b-4ec9-b7a8-cf00ce923e77 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:47.674807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e9649-047b-4ec9-b7a8-cf00ce923e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:47.675079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e9649-047b-4ec9-b7a8-cf00ce923e77 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:47.675704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e9649-047b-4ec9-b7a8-cf00ce923e77 None admin] RBAC: Adding query filter params (type=network) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:47.676005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e9649-047b-4ec9-b7a8-cf00ce923e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:47.677368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e9649-047b-4ec9-b7a8-cf00ce923e77 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:47.682832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 360/719] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:15:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:47.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25767-aa9e-4984-9f22-0270778aa3c3 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:47.947599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25767-aa9e-4984-9f22-0270778aa3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:47.947867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb25767-aa9e-4984-9f22-0270778aa3c3 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:47.949471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 360/720] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:47.955153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61477d-a957-41c3-9932-3738dd8f275d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:47.955442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61477d-a957-41c3-9932-3738dd8f275d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:47.955721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61477d-a957-41c3-9932-3738dd8f275d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:47.975914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-cf61477d-a957-41c3-9932-3738dd8f275d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:47.977113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cf61477d-a957-41c3-9932-3738dd8f275d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:48.050361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:48.071291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 361/721] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:48.453866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e2b7a-e178-49b7-87cd-5af4971c3842 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:48.454414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e2b7a-e178-49b7-87cd-5af4971c3842 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:48.454492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e2b7a-e178-49b7-87cd-5af4971c3842 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:48.456070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 361/722] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:48.461509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a28b42-0def-452b-abb3-90c46540f743 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:48.461800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a28b42-0def-452b-abb3-90c46540f743 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:48.462108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a28b42-0def-452b-abb3-90c46540f743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:48.486974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-16a28b42-0def-452b-abb3-90c46540f743 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:48.488162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-16a28b42-0def-452b-abb3-90c46540f743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:48.527755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e2b7a-e178-49b7-87cd-5af4971c3842 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:48.599195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 362/723] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:48.657478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e2b7a-e178-49b7-87cd-5af4971c3842 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:48.708089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:48.709052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:48.709662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:48.710508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:48.723796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:48.733950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:48.735871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:48.737225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:48.737878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d1993-6d34-4aeb-9a94-c4a2a2f800d8 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:48.737878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d1993-6d34-4aeb-9a94-c4a2a2f800d8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:48.737878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d1993-6d34-4aeb-9a94-c4a2a2f800d8 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:48.738624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 363/724] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:15:48.740339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 362/725] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:48.745887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964daa-6953-4a91-8e51-3163a6edb0b2 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:48.746454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964daa-6953-4a91-8e51-3163a6edb0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:48.746949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06964daa-6953-4a91-8e51-3163a6edb0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:48.751658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:48.777209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-06964daa-6953-4a91-8e51-3163a6edb0b2 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:48.781983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-06964daa-6953-4a91-8e51-3163a6edb0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:48.808683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:48.914624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 364/726] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 30 19:15:48.921852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06964daa-6953-4a91-8e51-3163a6edb0b2 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:48.925686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38337e-8030-438e-910e-a13a1285e159 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:48.965196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:48.965732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:48.965996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:48.966286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:48.966945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:48.967240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:48.968589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:48.982633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 363/727] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:48.988208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:49.026400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:49.124247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06964daa-6953-4a91-8e51-3163a6edb0b2 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.172696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:49.182920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a5006-4505-4336-9b75-c1e667a97faf None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.193062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.193672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.194014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.194306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.195102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:49.196475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:49.226647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 365/728] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:15:48 2022] POST /identity/v3/services => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:49.247441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:49.264335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.264991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.265267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.265538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.290749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:49.292218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:49.325872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:49.326930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:49.327849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:49.327849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:49.327849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:49.331575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 364/729] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:49.339249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:49.444837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757440e9-2497-4954-a637-5d7914e967f6 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.463156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:49.490497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.491936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.492321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.492701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.504960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:49.511223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:49.512203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:49.513057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 366/730] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:49.520724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:49.525401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e2b46-1e98-4f05-b6dc-0867cdbbc501 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.564581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.565198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.565480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.565755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.566493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:49.566804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:49.569030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:49.582688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 365/731] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:49.591211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:49.597608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:49.649174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e909-116f-4551-81a9-62a16c807aed None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.697165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.697984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.698458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.698835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.699680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:49.700777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:49.701893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:49.715674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731315a-6540-48bd-a77f-1494dc436ae7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.724697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 367/732] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:49.728188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:49.793131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ae298-d368-4012-9f5c-48fc9a26a1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.794914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae298-d368-4012-9f5c-48fc9a26a1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.795971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae298-d368-4012-9f5c-48fc9a26a1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.796586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ae298-d368-4012-9f5c-48fc9a26a1f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.802374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:49.813790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ae298-d368-4012-9f5c-48fc9a26a1f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:49.818182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ae298-d368-4012-9f5c-48fc9a26a1f8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-604ae298-d368-4012-9f5c-48fc9a26a1f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:49.832586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:49.833577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:49.835587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:49.838358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 366/733] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:49.839819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9211-9e38-439f-a50d-878d330f6a80 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.840311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9211-9e38-439f-a50d-878d330f6a80 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.840903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9211-9e38-439f-a50d-878d330f6a80 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.842622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 367/734] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:49.847583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca9211-9e38-439f-a50d-878d330f6a80 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:49.889384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59378b60-48fe-4d25-bd47-9ca77b3f97d5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.922727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:49.933645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2c4c5-c5d6-42d6-abb2-ad26a1077e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.934325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2c4c5-c5d6-42d6-abb2-ad26a1077e03 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.934857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2c4c5-c5d6-42d6-abb2-ad26a1077e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.935351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2c4c5-c5d6-42d6-abb2-ad26a1077e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.949963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2c4c5-c5d6-42d6-abb2-ad26a1077e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:49.952122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2c4c5-c5d6-42d6-abb2-ad26a1077e03 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:49.958935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca9211-9e38-439f-a50d-878d330f6a80 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e1f2c4c5-c5d6-42d6-abb2-ad26a1077e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:49.971533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:49.972548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:49.973469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:49.973469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:49.973469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:49.973469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 368/735] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:49.974249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e5ab-7b2a-4fc7-acec-79e09bb7a44b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:49.974565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e5ab-7b2a-4fc7-acec-79e09bb7a44b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:49.975608 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2e5ab-7b2a-4fc7-acec-79e09bb7a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:49.999494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:49.999694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-cef2e5ab-7b2a-4fc7-acec-79e09bb7a44b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:50.000564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.000942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cef2e5ab-7b2a-4fc7-acec-79e09bb7a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:50.001282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.001743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.002750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:50.003646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:50.005533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:50.026642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 368/736] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 30 19:15:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:50.027799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:50.108222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 369/737] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:50.109539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e5ab-7b2a-4fc7-acec-79e09bb7a44b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:50.132258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:50.191927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067e2b-4325-4b1f-b5be-2ad111b2f280 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:50.237352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:50.259383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:50.260000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.260276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.260543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.261192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:50.261492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:50.263080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:50.269208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2e5ab-7b2a-4fc7-acec-79e09bb7a44b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:50.285680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 369/738] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:50.292201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:50.335354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3064de-b238-472f-9e9d-830f36da28ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:50.337874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3064de-b238-472f-9e9d-830f36da28ce None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.338575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3064de-b238-472f-9e9d-830f36da28ce None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.340173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3064de-b238-472f-9e9d-830f36da28ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.467905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfd21f-19bb-4015-a79a-6c93b899226f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:50.474694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3064de-b238-472f-9e9d-830f36da28ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:50.476485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3064de-b238-472f-9e9d-830f36da28ce None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:50.495626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:50.523047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:50.525185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.525185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.525185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.534565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:50.536093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:50.551375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:50.552532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:50.554261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:50.555123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 370/739] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:50.562073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:50.590432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 370/740] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 30 19:15:50.591697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d989-bb8f-452e-a8d4-0dfc5bd53cf6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.591989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d989-bb8f-452e-a8d4-0dfc5bd53cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.592328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867d989-bb8f-452e-a8d4-0dfc5bd53cf6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.593570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 371/741] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:50.594353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d989-bb8f-452e-a8d4-0dfc5bd53cf6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:50.610698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:50.676391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d7a21-c428-4457-a999-d507da6fe8fc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:50.710583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867d989-bb8f-452e-a8d4-0dfc5bd53cf6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:50.711609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:50.712242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.712521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.712791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.722900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:50.728148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:50.728521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:50.729525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 371/742] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:50.730931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:50.752633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321758-6aa2-4842-b75b-8ea811f125b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:50.753739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321758-6aa2-4842-b75b-8ea811f125b2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.753856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321758-6aa2-4842-b75b-8ea811f125b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.754120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321758-6aa2-4842-b75b-8ea811f125b2 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.754838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321758-6aa2-4842-b75b-8ea811f125b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:50.755140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321758-6aa2-4842-b75b-8ea811f125b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:50.757312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321758-6aa2-4842-b75b-8ea811f125b2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:50.775504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 372/743] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:50.780666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551e838-64d6-4eba-a9cd-bf43d5cf1669 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.780666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551e838-64d6-4eba-a9cd-bf43d5cf1669 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.780666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551e838-64d6-4eba-a9cd-bf43d5cf1669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.795918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f551e838-64d6-4eba-a9cd-bf43d5cf1669 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:50.797231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f551e838-64d6-4eba-a9cd-bf43d5cf1669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:50.845354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d81d9e-475f-4540-a92f-0d268dfdfe53 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:50.846831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:50.867486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 373/744] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 30 19:15:50.868545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551e838-64d6-4eba-a9cd-bf43d5cf1669 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:50.886832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:50.887609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:50.887981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:50.888357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:50.902025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:50.903716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:50.921409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:50.922622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:50.923623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:50.923623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:50.923623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:50.929216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 372/745] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:50.930189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.001256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551e838-64d6-4eba-a9cd-bf43d5cf1669 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.003973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.037661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.038487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.038832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.039168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.040015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:51.040346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.041905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.055852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 374/746] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:51.062290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.065448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d1f4c-2f26-43e5-908a-97ff5b234b0d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.108867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.110315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.111041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.111501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.125130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.127524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:51.145084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:51.146122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:51.147838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:51.147838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:51.147838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:51.150371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 373/747] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:51.151354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.162453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.179926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4aa05-3ea7-4e53-9604-b3524983cef1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.217547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.218189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.218474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.218753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.219391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:51.219725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.221107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.233890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 375/748] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:51.234736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.265388 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.265573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e0a47-9d96-420c-a441-20ccab529cc8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.303044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.303798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.304219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.304496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.315574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.317011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:51.332252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:51.333265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:51.334245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:51.334245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:51.334245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:51.334245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 374/749] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:51.334528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.349429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbe2a3-3204-4304-be67-3712bf5f1f30 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.385670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.386223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.386501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.386769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.387400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:51.387697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.389051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.400726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 376/750] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:51.401796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.407892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.455574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545edc33-3bf3-4d38-a6ab-b0857aa4739c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.491891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.493557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.494383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.494769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.495110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.495805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.497175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.511772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8debd1-4286-44ce-951e-9ef9cde2ae5d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.513981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 375/751] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:15:51 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:51.514819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.578851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.580650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.581136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.581734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.592394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.594798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:51.612979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:51.613969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:51.614935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:51.624206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 377/752] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:51.625486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.656928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492782d-2f43-4948-86c9-0b986034e014 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.680772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.702232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.703490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.703881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.704153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.704955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:51.705258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.706764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.724189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 376/753] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:51.725093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.772212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddf171-85aa-462a-a8f1-e2d3872e44f2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.809142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.809781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.810195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.810472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.817678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.819771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:51.831057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:51.832008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 378/754] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:51.832933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.836334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.849120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5770e-7abc-4f50-b8cd-d0a1ccd16d41 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.887721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edcea2-00f9-4328-a824-0e8e5daa5e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.888365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edcea2-00f9-4328-a824-0e8e5daa5e49 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.888589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edcea2-00f9-4328-a824-0e8e5daa5e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.888856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edcea2-00f9-4328-a824-0e8e5daa5e49 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.889535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edcea2-00f9-4328-a824-0e8e5daa5e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:51.889957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edcea2-00f9-4328-a824-0e8e5daa5e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.891295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edcea2-00f9-4328-a824-0e8e5daa5e49 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:51.908957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 377/755] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:51.908957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036e052-a71c-4f55-b2d6-53034c12fc9c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.908957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036e052-a71c-4f55-b2d6-53034c12fc9c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.908957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036e052-a71c-4f55-b2d6-53034c12fc9c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.908957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 378/756] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:51.909401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036e052-a71c-4f55-b2d6-53034c12fc9c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:51.947571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d8b27-bcfe-4a5d-a231-53d4ea58bb52 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:51.952556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:51.984103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:51.984740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:51.985027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:51.985305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:51.994289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:51.995744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:52.007369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:52.008458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:52.009440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 379/757] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:52.010077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:52.025068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036e052-a71c-4f55-b2d6-53034c12fc9c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:52.066905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a673387-968f-41f1-916b-b70ef772a45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:52.067684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673387-968f-41f1-916b-b70ef772a45a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:52.067969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673387-968f-41f1-916b-b70ef772a45a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:52.068240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673387-968f-41f1-916b-b70ef772a45a None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:52.069299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a673387-968f-41f1-916b-b70ef772a45a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:52.069611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a673387-968f-41f1-916b-b70ef772a45a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:52.071073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a673387-968f-41f1-916b-b70ef772a45a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:52.081340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:52.089166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 379/758] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:52.089166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f80b-53a2-4876-961d-9193ce339f4b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:52.089166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f80b-53a2-4876-961d-9193ce339f4b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:52.089166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f80b-53a2-4876-961d-9193ce339f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:52.105629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1153f80b-53a2-4876-961d-9193ce339f4b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:52.106874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1153f80b-53a2-4876-961d-9193ce339f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:52.129577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df62b8c-0eb8-4b76-adf2-25143bfc1857 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:52.164194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:52.164728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:52.165008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:52.165283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:52.166013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=2975430fac884ff89b88b9fe1b76cb30) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:52.166394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:52.167834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:52.173880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 380/759] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:52 2022] GET /identity/v3/role_assignments?user.id=2975430fac884ff89b88b9fe1b76cb30&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:52.174713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:52.203148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 380/760] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:15:52.203350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f80b-53a2-4876-961d-9193ce339f4b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:52.268192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:52.361847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f61c4-b913-4a6b-b7fa-65d41ae2fefe None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:52.398238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:52.406471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f80b-53a2-4876-961d-9193ce339f4b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:52.407118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:52.407738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:52.408268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:52.408547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:52.410213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:52.410526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:52.411979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:52.435052 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 381/761] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 30 19:15:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:52.440336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:52.475399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:52.476087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:52.476369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:52.476644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/57667fb21646457b8871087abcbd978c/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:52.481779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=57667fb21646457b8871087abcbd978c, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:52.483269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:52.515496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 381/762] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:15:52 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/57667fb21646457b8871087abcbd978c/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:52.522926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:52.589270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565531f9-9c8e-4af1-bf71-390f5fb4a49f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:52.642485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:52.652141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:52.652775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:52.653957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:52.655094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:52.672666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f60cbf-1635-44f5-8f84-7add422b0f4e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:52.750485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:52.751099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:52.751388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:52.751725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:52.752323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:52.753956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:52.764856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:52.767107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:52.768390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:52.769485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:52.770438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 382/763] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Sep 30 19:15:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:52.775524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:52.786105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:52.787844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:52.912761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 382/764] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 19:15:52.918582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:52.936114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c63042-a06e-497e-9823-fc9c8570f934 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.013002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.013528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.013802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.014084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.014717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:53.015015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.016373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.028872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 383/765] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 30 19:15:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:53.039100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:53.049662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:53.062252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:53.110499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e258bb-5903-4339-be47-5d5312ec1474 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.158601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b271ef-93e5-46b9-b58c-cf12bf019576 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.197933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.198605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.198905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.199143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.211306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.211502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.212050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.212332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.212608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.212823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.213249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:53.213544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.215108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:53.228814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:53.229871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:53.230827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:53.230827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:53.230827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:53.230827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 383/766] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:53.231067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 384/767] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 30 19:15:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:53.236163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:53.240030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:53.352134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f6af3-67a9-4944-b565-4fd9b0228d67 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.388794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.389395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.389669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.389940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.390596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:53.391014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.392377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.394703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:53.407015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 384/768] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:53.412295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:53.440060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:53.479990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e978b9-e6ef-4d97-ae19-88ea8492cf04 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.540086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.540751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.541030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.541312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.541995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] RBAC: Adding query filter params (interface=public, service_id=8845e984eabc4dc88d12f82c9668c6ac, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:53.542336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.544306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.558224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 385/769] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:15:53 2022] GET /identity/v3/endpoints?service_id=8845e984eabc4dc88d12f82c9668c6ac&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:53.560605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:53.656292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b48f81-bb13-4939-b1d3-c0148bdfa87e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.697644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8033d12-b73e-451f-b604-ea56c48be9d9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.737468 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.738091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.738511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.738864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.739475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.743109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.754305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 386/770] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:15:53 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:53.762951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.763636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.763921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.764199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.773630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.775254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:53.787017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:53.788553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:53.789483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 385/771] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:53.794864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:53.815095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:53.943144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318a20a-3525-44e2-aafd-6576dba09bb0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:53.979785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc414608-524c-4004-8226-071a2972b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:53.980399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414608-524c-4004-8226-071a2972b91d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:53.980673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414608-524c-4004-8226-071a2972b91d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:53.980942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc414608-524c-4004-8226-071a2972b91d None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:53.981636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc414608-524c-4004-8226-071a2972b91d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:53.981937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc414608-524c-4004-8226-071a2972b91d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:53.983381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc414608-524c-4004-8226-071a2972b91d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:53.996867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 387/772] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:54.002597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:54.025051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502382d-3fa6-4965-b34d-c9290c120f67 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:54.025352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502382d-3fa6-4965-b34d-c9290c120f67 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:54.025855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502382d-3fa6-4965-b34d-c9290c120f67 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:54.027689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 388/773] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:15:54.035678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc31765-f37a-4877-b975-cc798c555b0f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:54.036092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc31765-f37a-4877-b975-cc798c555b0f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:54.036373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc31765-f37a-4877-b975-cc798c555b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:54.068067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4fc31765-f37a-4877-b975-cc798c555b0f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:54.069817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4fc31765-f37a-4877-b975-cc798c555b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:54.075106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:54.129003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40f96-2dea-49ad-b2d1-0ea52b92137b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:54.164748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:54.176865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 389/774] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:15:54.203803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:54.204750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:54.205230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:54.205716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:54.206778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=a2d7f47c973449069def6cc121df83f1) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:54.207289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:54.208938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:54.218343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 386/775] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:54 2022] GET /identity/v3/role_assignments?user.id=a2d7f47c973449069def6cc121df83f1&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:54.503837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc31765-f37a-4877-b975-cc798c555b0f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:54.624367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc31765-f37a-4877-b975-cc798c555b0f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:54.789748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea33fa-596e-455c-b014-adba40da7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:54.790408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea33fa-596e-455c-b014-adba40da7e09 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:54.790711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea33fa-596e-455c-b014-adba40da7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:54.790884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea33fa-596e-455c-b014-adba40da7e09 None admin] PATH_INFO: `/v3/services/network` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:54.791449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea33fa-596e-455c-b014-adba40da7e09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:54.792814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea33fa-596e-455c-b014-adba40da7e09 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-18ea33fa-596e-455c-b014-adba40da7e09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:54.802200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:54.803813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:54.805070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 390/776] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:54 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:54.815165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:54.965501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c8045-96f1-4bca-9215-62af0c9547f8 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:54.970499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92eda0-c8b1-4d0d-aecc-2fd740b49174 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:54.970784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92eda0-c8b1-4d0d-aecc-2fd740b49174 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:54.971054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92eda0-c8b1-4d0d-aecc-2fd740b49174 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:54.972514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 391/777] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:54.984855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edb7a6-12e9-4358-8f29-6ad6731eed5c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:54.985127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edb7a6-12e9-4358-8f29-6ad6731eed5c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:54.985404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52edb7a6-12e9-4358-8f29-6ad6731eed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:54.999332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:55.014492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:55.014492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.014492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.014492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.015093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] RBAC: Adding query filter params (name=network) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:55.015395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:55.016760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:55.026087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 387/778] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:15:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:55.027304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-52edb7a6-12e9-4358-8f29-6ad6731eed5c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:55.027786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:55.028914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-52edb7a6-12e9-4358-8f29-6ad6731eed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:55.142426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:55.166088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 392/779] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:15:55.192571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2885c8-521f-4697-8990-8d1d1c5e3900 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.192890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2885c8-521f-4697-8990-8d1d1c5e3900 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.193122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2885c8-521f-4697-8990-8d1d1c5e3900 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.195734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 393/780] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:55.201641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9086d8-559b-4a33-894f-99064e1b6312 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.201928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9086d8-559b-4a33-894f-99064e1b6312 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.202223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9086d8-559b-4a33-894f-99064e1b6312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.213952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7267-12cf-4cb1-a726-7f2435741597 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:55.235091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ac9086d8-559b-4a33-894f-99064e1b6312 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:55.236351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ac9086d8-559b-4a33-894f-99064e1b6312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:55.292352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:55.292970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.293252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.293527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.294178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] RBAC: Adding query filter params (type=network) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:55.294484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:55.295861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:55.305831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 388/781] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:15:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:55.312188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:55.383449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:55.384509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 394/782] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:15:55.445535 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d52b8-9e50-4e35-8c1d-cf3c4fc1c23e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:55.482892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:55.483502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.483778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.484048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.484735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] RBAC: Adding query filter params (interface=public, service_id=59b3d8e21a9048b4bea98d530e7bc514, region_id=RegionOne) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:55.485039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:55.486422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:55.498166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 389/783] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:15:55 2022] GET /identity/v3/endpoints?service_id=59b3d8e21a9048b4bea98d530e7bc514&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:55.500279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9086d8-559b-4a33-894f-99064e1b6312 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:55.509360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:55.641169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e56db-0de4-42dc-9c29-abd24b784ad1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:55.669084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:55.681020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:55.681664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.681949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.682256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.694950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9086d8-559b-4a33-894f-99064e1b6312 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:55.698010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:55.703822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:55.704843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:55.705699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:55.706385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 390/784] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:55.707857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:55.727534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:55.741249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:55.742267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.742773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.743254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.744061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:55.745619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:55.751394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 395/785] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:15:55 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:55.752440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:55.898343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac3443-7a81-4fb4-872d-438c5200ce67 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:55.964331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:55.964976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710be8f-d374-4719-a88c-ebc58d419e1f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:55.965416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:55.965416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:55.965553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:55.980860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:55.986389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:55.987551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:55.988430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 391/786] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:55.993418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.019407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.020608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.021066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.021626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.022971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:56.023487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.025372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.029842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:56.038223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 396/787] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:56.044089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.101532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:56.112344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c9f4-f56c-4657-8634-d4e6f262702c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.152964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.153488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.154004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.155018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:56.155458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.157164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.159837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218272c-bedb-46ea-a83f-4942ff59d3a1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.168053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 392/788] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:56.173062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.197216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.197991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.198568 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.198748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.210174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.211841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:56.226802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:56.228005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:56.229117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:56.229117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:56.229117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:56.230428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 397/789] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:56.235875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.282409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:56.290628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853f695-3137-4e98-98b9-be65279a0463 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.329420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.330393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.330861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.331373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.341972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:56.345001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba448e9-a8ac-4e96-9b27-89e6db5cfb9d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.346626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.348455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:56.367028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:56.368081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:56.368997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:56.368997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:56.368997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:56.371456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 393/790] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:56.376746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.384822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.385442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.385720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.385989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.386676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:56.386976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.388367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.402812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 398/791] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:56.408231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.538721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdee63d-417d-490a-acd1-fe0a8e6297c5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.542700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad82c8-dc2b-4ca5-9ceb-dff32119b3d8 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.581173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2be12c-531b-4d1e-b96c-99b999987dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.581780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2be12c-531b-4d1e-b96c-99b999987dcf None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.582110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2be12c-531b-4d1e-b96c-99b999987dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.582362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2be12c-531b-4d1e-b96c-99b999987dcf None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.582865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16e7a7-ff92-404c-b6f0-44df54d80004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.582987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2be12c-531b-4d1e-b96c-99b999987dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:56.583283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2be12c-531b-4d1e-b96c-99b999987dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.583668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16e7a7-ff92-404c-b6f0-44df54d80004 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.584045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16e7a7-ff92-404c-b6f0-44df54d80004 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.584378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16e7a7-ff92-404c-b6f0-44df54d80004 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.584840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2be12c-531b-4d1e-b96c-99b999987dcf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.592807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16e7a7-ff92-404c-b6f0-44df54d80004 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.595439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16e7a7-ff92-404c-b6f0-44df54d80004 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.599339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 394/792] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:56.601403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24fae-1f06-4143-988d-1954de388d0e None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.601767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24fae-1f06-4143-988d-1954de388d0e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.602155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e24fae-1f06-4143-988d-1954de388d0e None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.607951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 395/793] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-8c16e7a7-ff92-404c-b6f0-44df54d80004 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:56.608711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:56.609629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:15:56.611529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:56.612479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24fae-1f06-4143-988d-1954de388d0e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.612598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 399/794] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:56.612598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a816779-0876-48a8-b0f1-1ab719aa3061 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.612598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a816779-0876-48a8-b0f1-1ab719aa3061 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.612598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a816779-0876-48a8-b0f1-1ab719aa3061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.626688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:56.638398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7a816779-0876-48a8-b0f1-1ab719aa3061 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:56.639717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7a816779-0876-48a8-b0f1-1ab719aa3061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:56.654760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:56.709231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 400/795] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:15:56.714910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a816779-0876-48a8-b0f1-1ab719aa3061 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.739558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e24fae-1f06-4143-988d-1954de388d0e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.793205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.794229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.794710 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.795307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.813300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.815230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:56.838347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:56.839363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:15:56.840349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:56.840901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a816779-0876-48a8-b0f1-1ab719aa3061 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:56.851861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 396/796] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:56.856926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.877554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:56.878491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:56.878767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:56.879040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:56.879803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:56.880102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:56.882256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:56.907465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 401/797] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:56.918339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:56.935081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.020817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28470a-4f58-4821-883e-697b5652bb8a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.029708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.064263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf910f2-1b62-44cb-aed2-c935d39c7bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.064898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf910f2-1b62-44cb-aed2-c935d39c7bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.065169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf910f2-1b62-44cb-aed2-c935d39c7bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.065433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf910f2-1b62-44cb-aed2-c935d39c7bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.078345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf910f2-1b62-44cb-aed2-c935d39c7bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:57.080102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf910f2-1b62-44cb-aed2-c935d39c7bb1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:57.081108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd8a44-fa0a-43be-9588-6d761ba2540a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2bf910f2-1b62-44cb-aed2-c935d39c7bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:57.102916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:57.103996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:57.104932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:57.104932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:57.104932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:57.107226 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 402/798] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:57.108357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f254448-529f-44aa-98f3-ea3548b26262 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.108632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f254448-529f-44aa-98f3-ea3548b26262 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.108898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f254448-529f-44aa-98f3-ea3548b26262 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.118911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 403/799] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:57.118911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f254448-529f-44aa-98f3-ea3548b26262 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.132769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef9441-8ad1-4222-a774-504b38240a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.133745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9441-8ad1-4222-a774-504b38240a8d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.134251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9441-8ad1-4222-a774-504b38240a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.134531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef9441-8ad1-4222-a774-504b38240a8d None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.135262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef9441-8ad1-4222-a774-504b38240a8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:57.135570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef9441-8ad1-4222-a774-504b38240a8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:57.137017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef9441-8ad1-4222-a774-504b38240a8d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:57.155969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 397/800] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:15:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:57.157173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55d72-b6a3-4e0b-9144-23cc36d88768 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.157461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55d72-b6a3-4e0b-9144-23cc36d88768 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.157797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f55d72-b6a3-4e0b-9144-23cc36d88768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.189799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.238758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f254448-529f-44aa-98f3-ea3548b26262 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.279119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.279741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.280021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.280293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.280945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:57.281247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:57.282649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:57.292076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-19f55d72-b6a3-4e0b-9144-23cc36d88768 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:57.293276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-19f55d72-b6a3-4e0b-9144-23cc36d88768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:57.295456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 404/801] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:57.296442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.374098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 398/802] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:15:57.374098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f55d72-b6a3-4e0b-9144-23cc36d88768 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.415296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379ea17-9763-4d26-b332-a201f2b542b1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.437155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.444075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.464690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.466341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.466841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.467327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.468322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:57.470718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:57.483275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:57.484282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 30 19:15:57.485119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:57.492343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 405/803] 10.222.0.18 () {56 vars in 1129 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:57.492343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.492542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f55d72-b6a3-4e0b-9144-23cc36d88768 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.530061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.530692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.531106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.531337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.604675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:57.606275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:57.617265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dc41b-4321-4c23-8f9e-52641475704f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.656751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.657517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.657911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.658301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.661232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.667170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:57.669357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:57.682044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:57.683156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:57.684107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:57.688919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 406/804] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:57.689640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.715869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 399/805] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:15:57.715869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.749008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.816094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152c0e-9194-4cf3-b210-b84d09494e0a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.816297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c20be-3268-4043-aef4-7c94acda154d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.851611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.852215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.852490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.852760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.854904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:57.855508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:57.855790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:57.856065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:57.856691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:57.856995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:57.858385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:57.862847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:15:57.868362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 407/806] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:57.868362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:15:57.868562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:57.869735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 400/807] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:57.870877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:57.887746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:57.978315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc9623-7ac9-4606-b659-0d901f826fb9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.984483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164761-9873-4f06-b370-3d1f4e93ba55 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:57.993886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.014546 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.015175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.015454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.015728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.023728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.024251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.024589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.024869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.025559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:58.026124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.027317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.028243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.029682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.045362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 408/808] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:58.045362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:58.045630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:58.046993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:58.047921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:58.047921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:58.047921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:58.047921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 401/809] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:58.047921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.128813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.156577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde664-7fb7-415d-9327-0b073f3b835b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.166445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53c366-a2c4-4512-b5bd-61c694876507 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.193785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.194513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.194852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.195193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.195895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:58.196271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.197712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.202577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 409/810] 10.222.0.18 () {56 vars in 1124 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:58.203329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.208815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.209514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.209796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.210092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.210755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:58.211060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.212446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.220910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 402/811] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:58.226801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.238161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.320393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1821f-4b72-43e3-9568-4a2e08502918 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.337782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856fda-f49d-4e31-a79b-193357fd51cb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.355599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.356263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.356545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.356822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/2975430fac884ff89b88b9fe1b76cb30/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.358723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=2975430fac884ff89b88b9fe1b76cb30, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.360153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.367159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.374400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 410/812] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:15:58 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/2975430fac884ff89b88b9fe1b76cb30/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:15:58.375229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.384704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.385465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.385744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.386154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.386809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:58.387113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.388536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.407075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 403/813] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:58.408011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.489751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.503188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb593b-10c4-4bc0-ae01-a9f631f162d5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.526999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a2189-fb06-4c96-8c25-2e0b19f15319 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.543462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190670-500f-4b99-940d-e16f44fef848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.544080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190670-500f-4b99-940d-e16f44fef848 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.544370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190670-500f-4b99-940d-e16f44fef848 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.544634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190670-500f-4b99-940d-e16f44fef848 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.545308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190670-500f-4b99-940d-e16f44fef848 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.546737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190670-500f-4b99-940d-e16f44fef848 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.569587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c022e-637f-4f5c-8bca-ac18140707e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.570366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c022e-637f-4f5c-8bca-ac18140707e3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.570703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c022e-637f-4f5c-8bca-ac18140707e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.570983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c022e-637f-4f5c-8bca-ac18140707e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.576532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 411/814] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:15:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:15:58.577951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0ca0-6385-4d34-a073-5d7107de343c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.578260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0ca0-6385-4d34-a073-5d7107de343c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.578534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b0ca0-6385-4d34-a073-5d7107de343c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.579865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 412/815] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:15:58.580433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b0ca0-6385-4d34-a073-5d7107de343c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.582785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c022e-637f-4f5c-8bca-ac18140707e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.584879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c022e-637f-4f5c-8bca-ac18140707e3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-337c022e-637f-4f5c-8bca-ac18140707e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:58.602864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:58.603912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:58.604829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:58.604829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:58.604829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:58.605496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 404/816] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:58.606473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351e2d-867a-430e-8ae4-e4a4888c9353 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.606759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351e2d-867a-430e-8ae4-e4a4888c9353 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.607036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351e2d-867a-430e-8ae4-e4a4888c9353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.633068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9c351e2d-867a-430e-8ae4-e4a4888c9353 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:15:58.634463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9c351e2d-867a-430e-8ae4-e4a4888c9353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:15:58.689170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.734336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b0ca0-6385-4d34-a073-5d7107de343c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.741834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 405/817] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:15:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:15:58.743097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c351e2d-867a-430e-8ae4-e4a4888c9353 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.778704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.779357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.779640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.779914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.789928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.791433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:15:58.806011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:58.806966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:15:58.807916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:58.811983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 413/818] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:58.813181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.860892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.880063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c351e2d-867a-430e-8ae4-e4a4888c9353 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.926234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525077d-7cfb-4ca1-8189-f2ad62455cf9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:58.926812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.927606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.928730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.929004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.930504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:58.930817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.932366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.948738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 406/819] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:58.953462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:58.966433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:58.967418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:58.967922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:58.968394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:58.969287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:58.969805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:58.971530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:58.986473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:58.990117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 414/820] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:58.992066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:59.060467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:59.109671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e1917-e7a0-4010-a998-d685f5e4d2c5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.110262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20958514-b22e-4631-8c0b-5caa4c0e80ef None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.147995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:59.148253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:59.148858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:59.148974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:59.149211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:59.149401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:59.149505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:59.149856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:59.150739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=57667fb21646457b8871087abcbd978c) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:59.151151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:59.152669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:59.158984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:59.159167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 415/821] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/role_assignments?user.id=57667fb21646457b8871087abcbd978c&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:59.160636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:59.166824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:15:59.175406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:59.176663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:15:59.178009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:59.179449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 407/822] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:15:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:15:59.186088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:59.323148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:59.352266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00423c98-7b6e-4c8b-a49c-12b6686a3355 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.408855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cf0ed-a2dd-47e5-8874-c3571ee231ef None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.410023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:59.410794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:59.411737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:59.412616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:59.413844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:59.413844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:59.415489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:59.435823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 408/823] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 30 19:15:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:59.442729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:59.442875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:59.449485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:59.450415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:59.450911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:59.451466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] PATH_INFO: `/v3/services/network` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:59.452239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:59.453836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:59.465586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:59.466663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 30 19:15:59.467507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:15:59.470257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 416/824] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:15:59 2022] GET /identity/v3/services/network => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:59.477727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:59.567080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042086f-ef1a-4c9b-9d89-e8a79afb493f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.607168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8951c-39ab-43f0-8620-57dd7a8ed165 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.608742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:59.609638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:59.609921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:59.610273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:59.624705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:59.626486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:59.638476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:59.648317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:59.649216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:59.649574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:59.649913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:59.650722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] RBAC: Adding query filter params (name=network) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:59.651096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:15:59.652543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:15:59.653510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:15:59.655091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:15:59.655091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:15:59.655091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:15:59.655308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:59.657530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 409/825] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:15:59.665016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 417/826] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:15:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:15:59.665888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:59.666859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:15:59.775213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:15:59.855779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e3273-7342-43b0-b0ea-4c48d8657d76 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.893007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:15:59.893951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:15:59.894430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:15:59.894872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:15:59.895689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:15:59.896001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39b232-7ace-42fc-ad30-ad04f78f1d5f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:15:59.896541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:15:59.898150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:15:59.906156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 418/827] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:15:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:15:59.909418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:00.010817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:00.011730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:00.012185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:00.012623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:00.013493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:00.013968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:00.015528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:00.023289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5671d41-4204-45b0-9f4f-3dd3c33a68c8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:00.047198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 410/828] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:00.051725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:00.053467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:00.065349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:00.065961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:00.066270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:00.066546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:00.067215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:00.069360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:00.103299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 419/829] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:15:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:00.142620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:00.191473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea4604-e14c-452e-9f38-9c6e8bb546d1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:00.241483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:00.242177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:00.242453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:00.242721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:00.250632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:00.252105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:00.265271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:00.266390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:00.267312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 411/830] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:00.274608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:00.394147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83122-4d23-42bb-9289-461c1651fc49 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:00.428690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc32db7-8cbe-41e6-9421-689e57e1f61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:00.429297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc32db7-8cbe-41e6-9421-689e57e1f61f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:00.429571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc32db7-8cbe-41e6-9421-689e57e1f61f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:00.429839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc32db7-8cbe-41e6-9421-689e57e1f61f None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:00.430570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc32db7-8cbe-41e6-9421-689e57e1f61f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:00.430871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc32db7-8cbe-41e6-9421-689e57e1f61f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:00.432388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc32db7-8cbe-41e6-9421-689e57e1f61f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:00.447586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 420/831] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:00.453170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:00.571395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a87fb8-aad0-4e0d-9557-6791f7eb0d9b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:00.598404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:00.611216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f88f07-6e64-48ef-8cc7-8230ccb9752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:00.611873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88f07-6e64-48ef-8cc7-8230ccb9752d None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:00.612146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88f07-6e64-48ef-8cc7-8230ccb9752d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:00.612414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88f07-6e64-48ef-8cc7-8230ccb9752d None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/a2d7f47c973449069def6cc121df83f1/roles/4da09e30141c409e82711c6915ca3cf1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:00.628146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f88f07-6e64-48ef-8cc7-8230ccb9752d None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=a2d7f47c973449069def6cc121df83f1, role_id=4da09e30141c409e82711c6915ca3cf1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:00.629584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f88f07-6e64-48ef-8cc7-8230ccb9752d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:00.645554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 412/832] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:16:00 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/a2d7f47c973449069def6cc121df83f1/roles/4da09e30141c409e82711c6915ca3cf1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:16:01.030351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63306db7-9488-46dc-9871-c96f060b0f5c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.030729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63306db7-9488-46dc-9871-c96f060b0f5c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.030935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63306db7-9488-46dc-9871-c96f060b0f5c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.032516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 421/833] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:01.037672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe751d7-67e3-4a95-b8e7-a9da98ac6bff None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.038222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe751d7-67e3-4a95-b8e7-a9da98ac6bff None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.038699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe751d7-67e3-4a95-b8e7-a9da98ac6bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.057697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3fe751d7-67e3-4a95-b8e7-a9da98ac6bff None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:01.059226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3fe751d7-67e3-4a95-b8e7-a9da98ac6bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:01.134928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 413/834] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:01.209768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575408e5-4b7d-4189-b4b9-294e57b57786 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.210336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575408e5-4b7d-4189-b4b9-294e57b57786 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.210336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575408e5-4b7d-4189-b4b9-294e57b57786 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.211965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 422/835] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:01.217640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7009e-2201-400e-b5ad-6532648dc4c7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.218028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7009e-2201-400e-b5ad-6532648dc4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.218344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7009e-2201-400e-b5ad-6532648dc4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.237670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3fc7009e-2201-400e-b5ad-6532648dc4c7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:01.238880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3fc7009e-2201-400e-b5ad-6532648dc4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:01.314300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 414/836] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:01.419800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575408e5-4b7d-4189-b4b9-294e57b57786 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:01.457807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:01.528089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575408e5-4b7d-4189-b4b9-294e57b57786 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:01.562984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:01.563978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.564510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.564997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.575892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:01.581260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:01.582303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:01.583175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:01.586591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 423/837] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:01.592821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7009e-2201-400e-b5ad-6532648dc4c7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:01.595037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:01.621810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:01.709374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:01.718672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878746a-beac-472a-ab3e-a973a38d553e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:01.730642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7009e-2201-400e-b5ad-6532648dc4c7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:01.760071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:01.760724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.761001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.761290 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.761907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:01.763391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:01.774297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:01.775312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:01.776188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:01.778003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:01.778869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.779339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.779829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.780418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 424/838] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:01.780907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:01.781420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:01.781672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:01.783297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:01.799705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 415/839] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:01.801020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:01.891052 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:01.899437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7bfcdc-f0c3-45e0-b41e-7a4faba62f8b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:01.908223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23478-70b3-473c-849e-6fe70e2307b2 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:01.940376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e83b1-72ad-4115-9fb4-2d6f7379520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:01.940990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e83b1-72ad-4115-9fb4-2d6f7379520b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.941324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e83b1-72ad-4115-9fb4-2d6f7379520b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.941544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e83b1-72ad-4115-9fb4-2d6f7379520b None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.942233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e83b1-72ad-4115-9fb4-2d6f7379520b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:01.942533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e83b1-72ad-4115-9fb4-2d6f7379520b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:01.942933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfddf5-b597-4979-9b48-415bb27fe22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:01.943577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfddf5-b597-4979-9b48-415bb27fe22f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.943844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfddf5-b597-4979-9b48-415bb27fe22f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.944097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e83b1-72ad-4115-9fb4-2d6f7379520b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:01.944195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfddf5-b597-4979-9b48-415bb27fe22f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.953736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 425/840] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:01.953736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb21c34-06d6-492e-a635-69af3853fcf3 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.953736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb21c34-06d6-492e-a635-69af3853fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.953736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb21c34-06d6-492e-a635-69af3853fcf3 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:01.953736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 426/841] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:01.954775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb21c34-06d6-492e-a635-69af3853fcf3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:01.959542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfddf5-b597-4979-9b48-415bb27fe22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:01.961010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfddf5-b597-4979-9b48-415bb27fe22f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-01dfddf5-b597-4979-9b48-415bb27fe22f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:01.976165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:01.977230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:01.978672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:01.978672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:01.978672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:01.981814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 416/842] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:01.983028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ad42-5600-41c6-959d-1015088fb0ef None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:01.983313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ad42-5600-41c6-959d-1015088fb0ef None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:01.983501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:01.983605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323ad42-5600-41c6-959d-1015088fb0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.003624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9323ad42-5600-41c6-959d-1015088fb0ef None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:02.005114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9323ad42-5600-41c6-959d-1015088fb0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:02.072693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb21c34-06d6-492e-a635-69af3853fcf3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.086091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 417/843] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:02.086091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ad42-5600-41c6-959d-1015088fb0ef None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:02.115182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.116470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.116901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.117581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.118399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:02.118872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.120371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.125425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 427/844] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:02.181025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:02.219092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323ad42-5600-41c6-959d-1015088fb0ef None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.259079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.260061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.260498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.260946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.261826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:02.262313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.263888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.278041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 418/845] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:02.283218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:02.378284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:02.381156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:02.398041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9be5dc-1219-49bd-bac1-1115bab10d3e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.436232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.436789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.437071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.437345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.446095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.447841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:02.461164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:02.462254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:02.463321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 428/846] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:16:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:02.468192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:02.522006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ed44f-cc9f-435e-978d-150111930da3 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.561146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:02.573313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.574303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.575209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.575635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.576779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.578613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:02.591115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:02.592312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:02.593284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:02.595517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 419/847] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Sep 30 19:16:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:02.604571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:02.607044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e0295-1a8e-4145-9687-627bbb307ad5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.655248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.655858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.656139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.656411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.657137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:02.657440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.658895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.686388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 429/848] 10.222.0.18 () {56 vars in 1135 bytes} [Fri Sep 30 19:16:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:02.689163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:02.726425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:02.735105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50582031-5eca-4bcc-b9d4-8837bbb19d53 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.777500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.778338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.778711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.779074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.779814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:02.780218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.781911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.792434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 420/849] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:02.793809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:02.820354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eeb98-765e-4603-aa53-c699ab7dafe7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.859896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:02.864061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.865458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.865837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.866451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.916143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553671c-340d-4c92-8eaa-f758038b9b67 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:02.945986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.947962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.956805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc180269-077d-4034-a168-f5c10381b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:02.957129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:02.957413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180269-077d-4034-a168-f5c10381b752 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.957718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180269-077d-4034-a168-f5c10381b752 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.957994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc180269-077d-4034-a168-f5c10381b752 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.959978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc180269-077d-4034-a168-f5c10381b752 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:02.960564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc180269-077d-4034-a168-f5c10381b752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:02.961661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc180269-077d-4034-a168-f5c10381b752 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:02.966211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 421/850] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:02.967385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94b9b-abc2-40a1-a71f-75679f144e6d None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.967667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94b9b-abc2-40a1-a71f-75679f144e6d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.967936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94b9b-abc2-40a1-a71f-75679f144e6d None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:02.974105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 422/851] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:02.976870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e112b-bf66-4461-b4d0-16947aa274ff None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:02.977316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e112b-bf66-4461-b4d0-16947aa274ff None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:02.977733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e112b-bf66-4461-b4d0-16947aa274ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:03.001166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ce9e112b-bf66-4461-b4d0-16947aa274ff None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:03.003008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ce9e112b-bf66-4461-b4d0-16947aa274ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:03.091414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 430/852] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:03.093019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.107200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 423/853] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:03.210483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f459e9-0ea3-4b1b-82c1-827f6d81e749 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:03.220055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:03.259786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:03.260806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:03.261325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:03.261788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:03.273663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:03.275377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:03.290964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:03.292370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:03.293265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:03.293265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:03.293265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:03.295367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 431/854] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:03.301210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e112b-bf66-4461-b4d0-16947aa274ff None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.355081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:03.393276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.412680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e112b-bf66-4461-b4d0-16947aa274ff None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:03.462496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:03.463445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:03.463733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:03.464303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:03.464953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:03.465511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:03.467620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:03.482438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 424/855] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:03.491504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.519930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f50876-b0c1-4740-9daa-2d8465b88770 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:03.563278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:03.563278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:03.563278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:03.563278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:03.584375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:03.590768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:03.591920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:16:03.593007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:03.594959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 432/856] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:03.601166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.622975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:03.657572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39e595-2898-4bd2-bee5-5b00042a91bf None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:03.669147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:03.697557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:03.698229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:03.698510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:03.698783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:03.705753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:03.707412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:03.720412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:03.721344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:03.722284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:03.726433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 425/857] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:03.728462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.736651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31180db-1d1c-49e2-86ec-cc83f5da613f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:03.775127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:03.775731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:03.776009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:03.776283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:03.777632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:03.777632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:03.778672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:03.792616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 433/858] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:03.794022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.850966 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1f31d-a894-4439-9658-bc8dafd14956 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:03.889064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:03.889823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:03.890252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:03.890624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:03.891510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:03.891843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:03.893530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:03.914687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 426/859] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:03.917392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:03.919236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:03.945252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d5ff-f22a-4314-9622-5168f333d3e2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:03.948784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:03.992501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:03.993047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:03.993325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:03.993592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.007685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:04.009370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:04.028687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:04.029677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:04.030614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:04.030614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:04.030614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:04.033061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453f821-df5d-4c87-9f13-887712be9f98 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:04.034406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 434/860] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:04.035240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:04.082305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:04.082910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:04.083286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:04.083699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.084472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=2975430fac884ff89b88b9fe1b76cb30) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:04.084778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:04.086590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:04.096938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 427/861] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:03 2022] GET /identity/v3/role_assignments?user.id=2975430fac884ff89b88b9fe1b76cb30&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:04.156777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fd9e2-ebee-4058-908d-87e5055bdc2e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:04.195665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:04.203412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:04.204447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:04.204899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:04.205341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.206204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:04.207581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:04.210891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:04.225137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 435/862] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:04.235725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:04.346338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:04.357734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938820d-7868-4f24-b8f4-202ee230f92d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:04.394962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d55a-4ad7-4880-8425-5d658bd12041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:04.395724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d55a-4ad7-4880-8425-5d658bd12041 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:04.396444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d55a-4ad7-4880-8425-5d658bd12041 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:04.396714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d55a-4ad7-4880-8425-5d658bd12041 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.404776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d55a-4ad7-4880-8425-5d658bd12041 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:04.406235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d55a-4ad7-4880-8425-5d658bd12041 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e332d55a-4ad7-4880-8425-5d658bd12041 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:04.417804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:04.418994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:04.420351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 428/863] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:16:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:04.424706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:04.455511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696099d2-9974-4c04-98d4-9df605c8acc2 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:04.455862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696099d2-9974-4c04-98d4-9df605c8acc2 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:04.456074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696099d2-9974-4c04-98d4-9df605c8acc2 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.457528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 429/864] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:04.463251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411d7a3-52c8-4c12-bac3-39cb68a421ee None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:04.463543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411d7a3-52c8-4c12-bac3-39cb68a421ee None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:04.463817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411d7a3-52c8-4c12-bac3-39cb68a421ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.485551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5411d7a3-52c8-4c12-bac3-39cb68a421ee None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:04.486946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5411d7a3-52c8-4c12-bac3-39cb68a421ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:04.533887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ca20a-f63d-4e5e-a8fb-a138a6835c0e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:04.581131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:04.581745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:04.582024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:04.582329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.583080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:04.583895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:04.584413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 430/865] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:04.585376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:04.603738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 436/866] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 30 19:16:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:04.609023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411d7a3-52c8-4c12-bac3-39cb68a421ee None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:04.698633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:04.719269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411d7a3-52c8-4c12-bac3-39cb68a421ee None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:04.758877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:04.759493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:04.759773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:04.760046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:04.829037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:04.830544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:04.857047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:04.920218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:04.934923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:04.956115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 431/867] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:04.961393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:04.975378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc879fb9-b04d-4db4-8522-12d333cf2c6c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:05.012173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:05.013130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.013616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.014144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.014998 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:05.016559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:05.042571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 437/868] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:16:04 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:05.093072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed52b5a-4265-4773-b23e-eb6351f165fc None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:05.140538 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:05.141109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.141395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.141670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.153576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:05.155078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:05.172035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:05.173092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:05.174081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:05.174081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:05.174081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:05.174081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 432/869] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:05.179823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:05.300063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3dbe-1dd4-4886-bed8-4eca554115a0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:05.311628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:05.340641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af666979-bbfd-4155-b890-a7efff73ead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:05.341332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af666979-bbfd-4155-b890-a7efff73ead8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.341618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af666979-bbfd-4155-b890-a7efff73ead8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.342125 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af666979-bbfd-4155-b890-a7efff73ead8 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.343284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af666979-bbfd-4155-b890-a7efff73ead8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:05.343650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af666979-bbfd-4155-b890-a7efff73ead8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:05.345020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af666979-bbfd-4155-b890-a7efff73ead8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:05.358694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 438/870] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:05.364246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:05.374468 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01e49-f246-4979-9205-2bc7c8846215 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.374753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01e49-f246-4979-9205-2bc7c8846215 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.375033 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce01e49-f246-4979-9205-2bc7c8846215 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.376603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 439/871] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:05.381822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee7ae0-2eb4-4b47-a1ec-fbac5239f2eb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.382130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee7ae0-2eb4-4b47-a1ec-fbac5239f2eb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.382404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee7ae0-2eb4-4b47-a1ec-fbac5239f2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.401560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-71ee7ae0-2eb4-4b47-a1ec-fbac5239f2eb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:05.402828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-71ee7ae0-2eb4-4b47-a1ec-fbac5239f2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:05.406093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:05.481016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26837b3-a54a-4b79-9b6f-6da1202aaccc None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:05.484660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 440/872] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:05.523837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:05.524609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.524983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.525350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.532582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:05.534087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:05.545861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:05.546856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:05.547784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 433/873] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:05.556356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee7ae0-2eb4-4b47-a1ec-fbac5239f2eb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:05.660959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:05.665126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee7ae0-2eb4-4b47-a1ec-fbac5239f2eb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:05.701812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:05.702777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.703362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.703841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.704733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:05.705240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:05.706898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:05.719402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 441/874] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:05.726117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:05.760088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:05.830344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:05.840983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a329-0fbd-478d-8abf-894ebb08159a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:05.880963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1b4f2-c9df-462f-8b24-8f487ce4db39 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:05.886619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccecbc-2c50-4997-98ef-1afe6ed871b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:05.888106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccecbc-2c50-4997-98ef-1afe6ed871b6 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.888395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccecbc-2c50-4997-98ef-1afe6ed871b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.888676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccecbc-2c50-4997-98ef-1afe6ed871b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.889413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccecbc-2c50-4997-98ef-1afe6ed871b6 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=a2d7f47c973449069def6cc121df83f1) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:05.889724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccecbc-2c50-4997-98ef-1afe6ed871b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:05.891796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccecbc-2c50-4997-98ef-1afe6ed871b6 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:05.902092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 434/875] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:05 2022] GET /identity/v3/role_assignments?user.id=a2d7f47c973449069def6cc121df83f1&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:05.934970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b27ca-bfaf-42eb-b67c-643e8b2bc990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:05.936008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b27ca-bfaf-42eb-b67c-643e8b2bc990 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:05.936481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b27ca-bfaf-42eb-b67c-643e8b2bc990 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:05.936940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b27ca-bfaf-42eb-b67c-643e8b2bc990 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:05.937810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b27ca-bfaf-42eb-b67c-643e8b2bc990 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:05.939479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b27ca-bfaf-42eb-b67c-643e8b2bc990 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:05.959652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 442/876] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:16:05 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:06.409757 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712398-874c-4b54-9ae2-c661cd20b624 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:06.410410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712398-874c-4b54-9ae2-c661cd20b624 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:06.410410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712398-874c-4b54-9ae2-c661cd20b624 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:06.412602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 435/877] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:06.418160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ce5a-6953-4e0f-8408-a89cf1dd076d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:06.418448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ce5a-6953-4e0f-8408-a89cf1dd076d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:06.418722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ce5a-6953-4e0f-8408-a89cf1dd076d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:06.437410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ac48ce5a-6953-4e0f-8408-a89cf1dd076d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:06.438611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ac48ce5a-6953-4e0f-8408-a89cf1dd076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:06.454222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:06.523007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 443/878] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:06 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:06.792818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41712398-874c-4b54-9ae2-c661cd20b624 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:06.898028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41712398-874c-4b54-9ae2-c661cd20b624 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:06.938164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:06.938806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:06.939087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:06.939360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:06.939940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:06.941314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:06.951030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:06.952143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:06.953102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 436/879] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:06.958735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48ce5a-6953-4e0f-8408-a89cf1dd076d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:07.070733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48ce5a-6953-4e0f-8408-a89cf1dd076d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:07.098311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060bd22-6784-4b8d-b6eb-e87115e3831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:07.099631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bd22-6784-4b8d-b6eb-e87115e3831d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:07.099915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bd22-6784-4b8d-b6eb-e87115e3831d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:07.100190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bd22-6784-4b8d-b6eb-e87115e3831d None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:07.100821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060bd22-6784-4b8d-b6eb-e87115e3831d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:07.101123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060bd22-6784-4b8d-b6eb-e87115e3831d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:07.102637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060bd22-6784-4b8d-b6eb-e87115e3831d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:07.107569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 444/880] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:07.117227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:07.146513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:07.221631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfb380-aad0-4ee5-a5ff-f09b7d5ad833 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:07.257053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897dd01-ba79-434b-b1c0-6fbc237696fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:07.257712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897dd01-ba79-434b-b1c0-6fbc237696fd None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:07.257989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897dd01-ba79-434b-b1c0-6fbc237696fd None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:07.258285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897dd01-ba79-434b-b1c0-6fbc237696fd None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:07.258962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897dd01-ba79-434b-b1c0-6fbc237696fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:07.259265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897dd01-ba79-434b-b1c0-6fbc237696fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:07.260665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897dd01-ba79-434b-b1c0-6fbc237696fd None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:07.268833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 437/881] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:07.432289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f0a5-4b4c-47e5-bfc4-c1639fd25ccc None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:07.432479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f0a5-4b4c-47e5-bfc4-c1639fd25ccc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:07.432755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266f0a5-4b4c-47e5-bfc4-c1639fd25ccc None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:07.434368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 445/882] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:07.443150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356304a5-b969-43c0-b370-d5d88be2ffa8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:07.443650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356304a5-b969-43c0-b370-d5d88be2ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:07.444026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356304a5-b969-43c0-b370-d5d88be2ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:07.462648 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-356304a5-b969-43c0-b370-d5d88be2ffa8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:07.463830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-356304a5-b969-43c0-b370-d5d88be2ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:07.533002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 438/883] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:07.804240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f0a5-4b4c-47e5-bfc4-c1639fd25ccc None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:07.818034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:07.921046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266f0a5-4b4c-47e5-bfc4-c1639fd25ccc None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:07.967152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:07.967794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:07.968076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:07.968351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:07.968934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:07.970413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:07.979984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:07.981052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:07.981911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 446/884] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:07.989288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356304a5-b969-43c0-b370-d5d88be2ffa8 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:08.004254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:08.100040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356304a5-b969-43c0-b370-d5d88be2ffa8 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:08.135999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd0bd9-890f-451d-ab59-ceca54920ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:08.136601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0bd9-890f-451d-ab59-ceca54920ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.136876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0bd9-890f-451d-ab59-ceca54920ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.137142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd0bd9-890f-451d-ab59-ceca54920ba3 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.137773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0bd9-890f-451d-ab59-ceca54920ba3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:08.138092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0bd9-890f-451d-ab59-ceca54920ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:08.139506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd0bd9-890f-451d-ab59-ceca54920ba3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:08.145688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 439/885] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:08.151475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:08.241462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:08.269266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d5c38-9e19-4bfb-bf40-57fa6ac15d50 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.269597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d5c38-9e19-4bfb-bf40-57fa6ac15d50 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.269818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d5c38-9e19-4bfb-bf40-57fa6ac15d50 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.272413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 440/886] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:08.276369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01962af-dbaa-495c-8a4f-3d58481e0dca None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:08.277336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f497c-ea31-45c5-8722-8078b332b7f9 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.277627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f497c-ea31-45c5-8722-8078b332b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.278007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f497c-ea31-45c5-8722-8078b332b7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.296934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-175f497c-ea31-45c5-8722-8078b332b7f9 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:08.298236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-175f497c-ea31-45c5-8722-8078b332b7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:08.318145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:08.319078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.319371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.320010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.320640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:08.320937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:08.322387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:08.328877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 447/887] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:08.335601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:08.379729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 441/888] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:08.382613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b71c0c-4f02-4f04-8267-0810eb1d2b60 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.383643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b71c0c-4f02-4f04-8267-0810eb1d2b60 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.384317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b71c0c-4f02-4f04-8267-0810eb1d2b60 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.386591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 442/889] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:08.392644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcbcb2-180d-4e28-8318-e7f9d20a5dcb None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.392925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcbcb2-180d-4e28-8318-e7f9d20a5dcb None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.393198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcbcb2-180d-4e28-8318-e7f9d20a5dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.410387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:08.419732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-60dcbcb2-180d-4e28-8318-e7f9d20a5dcb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:08.422325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-60dcbcb2-180d-4e28-8318-e7f9d20a5dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:08.457511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398713-c999-4dc3-a11a-ea46d326ab46 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:08.495176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:08.495942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.496318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.496693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.497487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] RBAC: Adding query filter params (interface=public, service_id=a2983e18dfc4415985fc44491c9d093c, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:08.497910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:08.499686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:08.500820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 443/890] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:08.510457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 448/891] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:16:08 2022] GET /identity/v3/endpoints?service_id=a2983e18dfc4415985fc44491c9d093c&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:08.522077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcbcb2-180d-4e28-8318-e7f9d20a5dcb None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:08.617274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcbcb2-180d-4e28-8318-e7f9d20a5dcb None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:08.652682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:08.653288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.653567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.653835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.654459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:08.655813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:08.657598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:08.666175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 444/892] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:16:08 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:16:08.676723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:08.680251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:08.781794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:08.796534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98521f1-22c6-4c6c-a3f8-b4e879b8658c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:08.839049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:08.839727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.840008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.840287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.840875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:08.844837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:08.856057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:08.857030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:08.858251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 449/893] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Sep 30 19:16:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:08.863324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:08.921842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097e6c-f662-450e-9f7e-1d9c7efec36f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:08.946475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:08.968193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:08.969843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:08.970370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:08.970720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:08.987939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca779ad-e9a8-465a-a052-ed37af770c41 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:08.990707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:08.997370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:08.998395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:08.999288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:08.999988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 445/894] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 30 19:16:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:09.008069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.031054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.032256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.032544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.033112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.033755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:09.034255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.035700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.041934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 450/895] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:09.047436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.074749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:09.130195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59024ad-1849-421d-9d50-8621e04a04f5 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.173208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c93100-04d8-4fe8-b6e1-ae297f51066b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.178995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.179620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.179902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.180178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.180853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:09.181156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.183229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.202077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 446/896] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:09.202077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.211276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:09.215309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.216136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.216497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.216851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.217559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:09.217944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.219423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.224970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 451/897] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:09.231015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.319967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857907-c20b-4abf-ad7b-538452a32422 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.346412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:09.356207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3830f55-2e1b-4be9-866f-b4003633b734 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.360039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.360691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.360975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.361254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.375996 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.377790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:09.395289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:09.396369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:09.397338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:09.397338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:09.397338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:09.401548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 447/898] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:09.402457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.408708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.409602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.410176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.410674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.412132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] RBAC: Adding query filter params (interface=public, service_id=bf7f49243ee344e99cc8af8e85f34a1f, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:09.413199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.415337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.422520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 452/899] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/endpoints?service_id=bf7f49243ee344e99cc8af8e85f34a1f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:09.428168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.507372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:09.545865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26298-411f-41be-abcd-b41cc4f28dac None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.553892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13707d63-5df2-4c5b-b924-10604696a321 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.584841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e402f-3328-4053-981f-ba193e67ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.585451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e402f-3328-4053-981f-ba193e67ae99 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.585732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e402f-3328-4053-981f-ba193e67ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.586005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e402f-3328-4053-981f-ba193e67ae99 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.586662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e402f-3328-4053-981f-ba193e67ae99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:09.586967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e402f-3328-4053-981f-ba193e67ae99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.588327 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e402f-3328-4053-981f-ba193e67ae99 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.591572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544a548-8e32-48e1-a91b-8d8946846b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.592387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a548-8e32-48e1-a91b-8d8946846b4a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.592849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a548-8e32-48e1-a91b-8d8946846b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.593318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a548-8e32-48e1-a91b-8d8946846b4a None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.594145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544a548-8e32-48e1-a91b-8d8946846b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.596196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544a548-8e32-48e1-a91b-8d8946846b4a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.600897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 448/900] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:09.602249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421b1c-1c68-4ce5-a92b-1f9ec26386f5 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.602536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421b1c-1c68-4ce5-a92b-1f9ec26386f5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.602812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421b1c-1c68-4ce5-a92b-1f9ec26386f5 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.608447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 449/901] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:09.608447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14421b1c-1c68-4ce5-a92b-1f9ec26386f5 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.613253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 453/902] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:16:09.615484 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971acd-a103-412c-8397-fe5b37ed0042 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.615975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971acd-a103-412c-8397-fe5b37ed0042 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.617053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971acd-a103-412c-8397-fe5b37ed0042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.644039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c4971acd-a103-412c-8397-fe5b37ed0042 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:09.646220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c4971acd-a103-412c-8397-fe5b37ed0042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:09.652702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:09.734350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 454/903] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:09.755885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14421b1c-1c68-4ce5-a92b-1f9ec26386f5 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.795407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.796044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.796322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.796595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.806735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.808184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:09.820422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:09.821435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:09.822464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 450/904] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:09.827455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971acd-a103-412c-8397-fe5b37ed0042 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:09.884792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:09.934775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971acd-a103-412c-8397-fe5b37ed0042 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:09.970408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:09.971381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:09.971889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:09.972386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:09.973417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:09.974270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:09.975911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:09.995424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 455/905] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:10.005084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:10.027363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:10.121308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:10.132532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8d7e-266e-4eb2-afc2-d8bebb23b9d9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:10.151169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57b3ec-6c6e-45bb-8f8f-4fcfbe1b4fe3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:10.164279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:10.184872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:10.185993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:10.186824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:10.187560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:10.191396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:10.193096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:10.193213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:10.193536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:10.194291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:10.195736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:10.218080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 456/906] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:16:10 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:10.276107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:10.277508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:10.387962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:10.397755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 451/907] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:09 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:10.405161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:10.517178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcf64d-6794-4851-ba89-4b046b5c71f8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:10.560097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:10.560737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:10.561017 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:10.561291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:10.574874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:10.576371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:10.592854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:10.593892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:10.594838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:10.594838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:10.594838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:10.594838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 457/908] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:10.600303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:10.708757 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876554-e57d-4a55-ba90-5518a566affc None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:10.745924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945ad3c-8a15-435e-9fee-f073cd3f99a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:10.746941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ad3c-8a15-435e-9fee-f073cd3f99a0 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:10.747499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ad3c-8a15-435e-9fee-f073cd3f99a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:10.747970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945ad3c-8a15-435e-9fee-f073cd3f99a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:10.748801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945ad3c-8a15-435e-9fee-f073cd3f99a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:10.749315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945ad3c-8a15-435e-9fee-f073cd3f99a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:10.750902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945ad3c-8a15-435e-9fee-f073cd3f99a0 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:10.763738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 452/909] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:10.770658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:10.794351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:10.885946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d876d-8c8a-470e-bdb1-1ab644cf91bc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:10.920051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2233-23a3-4f7f-aa0a-b71a1142fe61 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:10.920953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2233-23a3-4f7f-aa0a-b71a1142fe61 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:10.921416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f2233-23a3-4f7f-aa0a-b71a1142fe61 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:10.923209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:10.923641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 453/910] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:10.926102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:10.926102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:10.926102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:10.929554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f06e-60f2-46f3-8dd2-6c7e09621160 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:10.929851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f06e-60f2-46f3-8dd2-6c7e09621160 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:10.930169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f06e-60f2-46f3-8dd2-6c7e09621160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:10.932004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:10.933453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:10.946349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:10.947404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:10.948329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 458/911] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:10.949696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-61b1f06e-60f2-46f3-8dd2-6c7e09621160 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:10.954091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-61b1f06e-60f2-46f3-8dd2-6c7e09621160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:10.955110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:11.006550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:11.036804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 454/912] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:11.068997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:11.098334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b144788-22ae-424f-9216-2da8864580e9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:11.134866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:11.135590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:11.135865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:11.136190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:11.136905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:11.137208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:11.138758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:11.152960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 459/913] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:11.159922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1f06e-60f2-46f3-8dd2-6c7e09621160 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:11.277876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1f06e-60f2-46f3-8dd2-6c7e09621160 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:11.326776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:11.328047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:11.328478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:11.328908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:11.329803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] RBAC: Adding query filter params (role.id=c5fe7d00f1084287a9614fdc023f9f64, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=a2d7f47c973449069def6cc121df83f1) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:11.330279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:11.331863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:11.341171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 455/914] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:11 2022] GET /identity/v3/role_assignments?user.id=a2d7f47c973449069def6cc121df83f1&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=c5fe7d00f1084287a9614fdc023f9f64 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:11.369016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:11.496239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6b50f-4b43-46c3-93ce-c168ef339447 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:11.539265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:11.539908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:11.540183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:11.540452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:11.541035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:11.542415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:11.552975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:11.554034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:11.555525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 460/915] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:11.564083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:11.630400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:11.687592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf4246-52ca-4d4a-99ef-471e7cccac32 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:11.728330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:11.729502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:11.729997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:11.730576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:11.731603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:11.732394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:11.734359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:11.741271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 456/916] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:11.747357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:11.752863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:11.868824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73665db1-0350-4100-83de-906741c2bb61 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:11.908313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a69f52-6d2d-4885-bebb-8923e17e82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:11.908946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69f52-6d2d-4885-bebb-8923e17e82a9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:11.909187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69f52-6d2d-4885-bebb-8923e17e82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:11.909434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a69f52-6d2d-4885-bebb-8923e17e82a9 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:11.910084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69f52-6d2d-4885-bebb-8923e17e82a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:11.910402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69f52-6d2d-4885-bebb-8923e17e82a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:11.912615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a69f52-6d2d-4885-bebb-8923e17e82a9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:11.919233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 461/917] 10.222.0.18 () {56 vars in 1114 bytes} [Fri Sep 30 19:16:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:11.925406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:12.057944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667abca-8f89-476e-91a9-d2bb313be125 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:12.080297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:12.106962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622aa76-d06b-4423-bc4d-1608165c2322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:12.108003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622aa76-d06b-4423-bc4d-1608165c2322 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:12.108508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622aa76-d06b-4423-bc4d-1608165c2322 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:12.108976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622aa76-d06b-4423-bc4d-1608165c2322 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:12.109876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622aa76-d06b-4423-bc4d-1608165c2322 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:12.111475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622aa76-d06b-4423-bc4d-1608165c2322 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:12.137474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 457/918] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:16:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:12.154233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31bb4-9e16-4876-9cfd-7dbdcfb24cda None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:12.154602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31bb4-9e16-4876-9cfd-7dbdcfb24cda None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:12.154819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa31bb4-9e16-4876-9cfd-7dbdcfb24cda None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:12.156571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 462/919] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:12.163483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e793b-06e2-421a-8139-b8cf7098b621 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:12.164126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e793b-06e2-421a-8139-b8cf7098b621 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:12.164655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e793b-06e2-421a-8139-b8cf7098b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:12.186779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ab9e793b-06e2-421a-8139-b8cf7098b621 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:12.188453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ab9e793b-06e2-421a-8139-b8cf7098b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:12.279441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 458/920] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:12.552194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31bb4-9e16-4876-9cfd-7dbdcfb24cda None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:12.623627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:12.670211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa31bb4-9e16-4876-9cfd-7dbdcfb24cda None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:12.707906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c61c6-b341-4bd8-b5ac-d06c0f063bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:12.708630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c61c6-b341-4bd8-b5ac-d06c0f063bbb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:12.708913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c61c6-b341-4bd8-b5ac-d06c0f063bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:12.709267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c61c6-b341-4bd8-b5ac-d06c0f063bbb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:12.709851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c61c6-b341-4bd8-b5ac-d06c0f063bbb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:12.711255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c61c6-b341-4bd8-b5ac-d06c0f063bbb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-328c61c6-b341-4bd8-b5ac-d06c0f063bbb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:12.720164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:12.721131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:12.722034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 463/921] 10.222.0.18 () {56 vars in 1132 bytes} [Fri Sep 30 19:16:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:12.727585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e793b-06e2-421a-8139-b8cf7098b621 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:12.776580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28327415-aa01-4559-a357-267292b7eb0d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:12.776923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28327415-aa01-4559-a357-267292b7eb0d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:12.777129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28327415-aa01-4559-a357-267292b7eb0d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:12.778763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 464/922] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:12.783735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f546d-de5b-41fa-89c7-71d33b43a023 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:12.784014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f546d-de5b-41fa-89c7-71d33b43a023 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:12.784286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f546d-de5b-41fa-89c7-71d33b43a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:12.803456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-bc3f546d-de5b-41fa-89c7-71d33b43a023 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:12.804582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bc3f546d-de5b-41fa-89c7-71d33b43a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:12.837117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:12.845915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e793b-06e2-421a-8139-b8cf7098b621 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:12.896084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:12.896696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:12.896974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 465/923] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:12.897137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:12.897292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:12.897853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:12.898186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:12.899566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:12.904784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 459/924] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:12.910222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f546d-de5b-41fa-89c7-71d33b43a023 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:12.971078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:13.014129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f546d-de5b-41fa-89c7-71d33b43a023 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:13.065603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:13.066262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.066542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.066895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.067532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:13.067835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:13.069294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:13.074884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 466/925] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:13.080716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:13.178304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:13.189547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512def37-11fc-4e95-b54d-6013395de31d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:13.232712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:13.233425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.233738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.234148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.234827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:13.236204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:13.263430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 460/926] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:16:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:13.297779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49150061-a23c-4f7b-a84d-14a314152980 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:13.328445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:13.349705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:13.350433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.350713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.350986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.351715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:13.353162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:13.363410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:13.365177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:13.366680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 467/927] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:13.372256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:13.391299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:13.490557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e618d9-dedf-4287-bded-37ab3c96e697 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:13.527443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:13.528048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.528325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.528596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.529222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:13.529522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:13.530980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:13.536846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 461/928] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:13.542536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:13.653847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4512cf-2951-4125-a220-2fed145f4840 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:13.690925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f435770-f8de-4326-b6f9-641a8c590e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:13.691548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f435770-f8de-4326-b6f9-641a8c590e4d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.691989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f435770-f8de-4326-b6f9-641a8c590e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.692410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f435770-f8de-4326-b6f9-641a8c590e4d None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.693049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f435770-f8de-4326-b6f9-641a8c590e4d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:13.693352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f435770-f8de-4326-b6f9-641a8c590e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:13.696262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f435770-f8de-4326-b6f9-641a8c590e4d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:13.701118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 468/929] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:13.707229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:13.795738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:13.820920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5f2c1-0326-421b-a64c-ca54ffafe2be None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:13.825519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c54a7-ae55-400d-8d7f-2fdce4dda517 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.825810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c54a7-ae55-400d-8d7f-2fdce4dda517 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.826106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c54a7-ae55-400d-8d7f-2fdce4dda517 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.827916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 469/930] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:13.832904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5927e-162e-477e-8a73-0de3ca9e67c1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.833474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5927e-162e-477e-8a73-0de3ca9e67c1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.834011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5927e-162e-477e-8a73-0de3ca9e67c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.855817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2fc5927e-162e-477e-8a73-0de3ca9e67c1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:13.858039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2fc5927e-162e-477e-8a73-0de3ca9e67c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:13.862884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:13.863604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:13.863850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:13.864129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:13.864840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] RBAC: Adding query filter params (interface=public, service_id=a2ae5af59b0d4cb7be5db7eb193f07b6, region_id=RegionOne) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:13.865149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:13.866568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:13.873993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 462/931] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:16:13 2022] GET /identity/v3/endpoints?service_id=a2ae5af59b0d4cb7be5db7eb193f07b6&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:13.880073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:13.912549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:13.950186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 470/932] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:14.004879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32923025-7721-4fe9-aa52-7e5c9010ce54 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:14.041504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:14.042493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:14.043000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:14.043495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:14.044293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:14.045877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:14.053108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 463/933] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:16:13 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:16:14.228503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5927e-162e-477e-8a73-0de3ca9e67c1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:14.341814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5927e-162e-477e-8a73-0de3ca9e67c1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:14.380611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565941d9-9381-488a-b859-3d7f274b0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:14.381246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565941d9-9381-488a-b859-3d7f274b0821 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:14.381525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565941d9-9381-488a-b859-3d7f274b0821 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:14.381796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565941d9-9381-488a-b859-3d7f274b0821 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:14.392137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565941d9-9381-488a-b859-3d7f274b0821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-565941d9-9381-488a-b859-3d7f274b0821 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:14.397929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:14.398919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:14.399776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 471/934] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 30 19:16:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:14.405655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:14.417308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:14.443431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca10f1-7fc2-4233-a645-b57bfb07853c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:14.443738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca10f1-7fc2-4233-a645-b57bfb07853c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:14.443975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca10f1-7fc2-4233-a645-b57bfb07853c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:14.445995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 472/935] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:14.451135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d1b5-1e53-4614-8e15-6936b92e1cb6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:14.451412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d1b5-1e53-4614-8e15-6936b92e1cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:14.451681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d1b5-1e53-4614-8e15-6936b92e1cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:14.474631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b270d1b5-1e53-4614-8e15-6936b92e1cb6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:14.476293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b270d1b5-1e53-4614-8e15-6936b92e1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:14.516669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:14.522356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012f445-4d7f-4204-a957-2da77497b83f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:14.562321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 473/936] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:14.569346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:14.569959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:14.570259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:14.570524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:14.571181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:14.571479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:14.572848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:14.584688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 464/937] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 30 19:16:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:14.587588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270d1b5-1e53-4614-8e15-6936b92e1cb6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:14.694505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270d1b5-1e53-4614-8e15-6936b92e1cb6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:14.729582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:14.730236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:14.730511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:14.730777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:14.741071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:14.742526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:14.758029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:14.759020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:14.759930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:14.759930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:14.759930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:14.763859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 474/938] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:14.765207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:14.842459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:14.846348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:14.870834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ba235-0492-4e7d-a1fd-4488dfca9ae4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:14.874755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:14.907310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:14.908286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:14.908767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:14.909234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:14.910179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:14.910938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:14.912512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:14.925328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 465/939] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:14.931519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:14.984641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240f8da-f046-4c7f-aca0-6d8418d4603b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.026160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.026792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.027077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.027326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.027979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.029526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.032396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING keystone.server.flask.common [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 30 19:16:15.064830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.sql.core [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 19:16:15.064830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 19:16:15.064830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [parameters: {'id': 'f9c54575c013418d8994de8243f16819', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 19:16:15.064830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 19:16:15.070924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff566b3-1526-4c38-865d-ff5941eb5538 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9c54575c013418d8994de8243f16819.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9c54575c013418d8994de8243f16819. Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 19:16:15.074595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 30 19:16:15.075576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application yield resource Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise self.value Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application session.commit() Sep 30 19:16:15.076753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.flush() Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application compat.raise_( Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 19:16:15.077877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 19:16:15.079038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 19:16:15.080008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [parameters: {'id': 'f9c54575c013418d8994de8243f16819', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.081077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:15.082032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9c54575c013418d8994de8243f16819. Sep 30 19:16:15.083559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.090284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 475/940] 10.222.0.18 () {60 vars in 1140 bytes} [Fri Sep 30 19:16:14 2022] POST /identity/v3/projects => generated 262 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:15.092537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:15.116487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:15.126814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.127455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.127735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.128009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.136482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.138238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:15.151027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:15.152013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:15.157993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 466/941] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:16:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:15.160699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:15.194279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:15.220763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4425ce-4cbe-48eb-bf64-e060cabb2697 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.257416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.258072 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.258382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.258804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.265878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.267604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.277132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cb986-777e-48cc-a55e-cc784743a515 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:15.279440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:15.280304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:15.281220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:15.285507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 476/942] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:15.286459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:15.319459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.320541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.321075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.321558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.322502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:15.323017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.324827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.349094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 467/943] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:15.350939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:15.398238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29de18-a977-43be-8d15-67d9710efee7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.402497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:15.437365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.437975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.438283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.438554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.439323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:15.439627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.441153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.445908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:15.467110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54fff6-cb1e-4334-a5bd-1bf1021ddc29 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.475518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 477/944] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:15.509532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a641d-55a2-4884-ab98-948907f31533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.510584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a641d-55a2-4884-ab98-948907f31533 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.511084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a641d-55a2-4884-ab98-948907f31533 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.511567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a641d-55a2-4884-ab98-948907f31533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.523623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a641d-55a2-4884-ab98-948907f31533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.525438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a641d-55a2-4884-ab98-948907f31533 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-cf9a641d-55a2-4884-ab98-948907f31533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:15.542812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:15.543860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:15.544832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:15.544832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:15.544832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:15.552232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 468/945] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:15.555202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:15.588877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3135-ffee-4cb9-b912-b4f0f07968b4 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.589228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3135-ffee-4cb9-b912-b4f0f07968b4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.589540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e3135-ffee-4cb9-b912-b4f0f07968b4 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.591282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 469/946] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:15.596421 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ce12a-f7ed-4772-8a8b-9518e1f712b7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.596707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ce12a-f7ed-4772-8a8b-9518e1f712b7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.596986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ce12a-f7ed-4772-8a8b-9518e1f712b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.616716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c11ce12a-f7ed-4772-8a8b-9518e1f712b7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:15.617866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c11ce12a-f7ed-4772-8a8b-9518e1f712b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:15.685478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20563dd-b02f-4fe1-a039-6ab0abd0c066 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.697148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 470/947] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:15.725918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.726561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.726836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.727106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.727745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:15.728042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.729392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.742891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 478/948] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:15.748856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ce12a-f7ed-4772-8a8b-9518e1f712b7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:15.778670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:15.854681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ce12a-f7ed-4772-8a8b-9518e1f712b7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:15.890878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:15.891428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:15.891704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:15.891972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:15.899779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:15.901225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:15.913145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:15.914075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:15.915026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:15.918156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 471/949] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:15.920471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:15.981264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:16.000375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:16.031261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d03701-4064-4ac7-b155-0f3db40b348b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:16.071713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:16.072524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.072975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.073543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.074537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:16.074993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:16.076573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:16.092529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 479/950] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:16.099658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:16.123682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:16.142135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d0b45-ce95-48ea-9b49-36bf3eacc532 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:16.188840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:16.189475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.189753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.190024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.191058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:16.193513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:16.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:16.206680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:16.207676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:16.212618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 472/951] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:16.214515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:16.224321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fb44-1f90-46d7-83de-e33e4a469748 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:16.244676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:16.268615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef0c66-1eed-4760-a470-3dfd4d399e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:16.269633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0c66-1eed-4760-a470-3dfd4d399e0c None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.270445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0c66-1eed-4760-a470-3dfd4d399e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.270935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef0c66-1eed-4760-a470-3dfd4d399e0c None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/a2d7f47c973449069def6cc121df83f1/roles/c5fe7d00f1084287a9614fdc023f9f64` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.273482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef0c66-1eed-4760-a470-3dfd4d399e0c None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=a2d7f47c973449069def6cc121df83f1, role_id=c5fe7d00f1084287a9614fdc023f9f64)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:16.275151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef0c66-1eed-4760-a470-3dfd4d399e0c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:16.298206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 480/952] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:16:16 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/a2d7f47c973449069def6cc121df83f1/roles/c5fe7d00f1084287a9614fdc023f9f64 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:16:16.335863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6b59-459c-4c56-8313-0672bcbf103c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.336198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6b59-459c-4c56-8313-0672bcbf103c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.336425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d6b59-459c-4c56-8313-0672bcbf103c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.338121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 481/953] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:16.343668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b007ba-cf95-4ae1-afc0-7eb7bda608c7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.343956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b007ba-cf95-4ae1-afc0-7eb7bda608c7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.344222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b007ba-cf95-4ae1-afc0-7eb7bda608c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.350042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17716-fa14-473c-9d2f-34a6e55cc911 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:16.365248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-88b007ba-cf95-4ae1-afc0-7eb7bda608c7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:16.366870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-88b007ba-cf95-4ae1-afc0-7eb7bda608c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:16.399917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:16.400721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.400999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.401522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.402337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:16.402671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:16.404088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:16.417527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 473/954] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:16:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:16.420590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:16.446722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:16.466563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 482/955] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:16.539255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed90ef-ebaa-4674-8a9a-d7ad32be9124 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:16.574103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:16.574964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.575382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.575804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.576568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:16.577010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:16.578634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:16.590185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 474/956] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:16:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:16.743526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b007ba-cf95-4ae1-afc0-7eb7bda608c7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:16.849512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b007ba-cf95-4ae1-afc0-7eb7bda608c7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:16.858587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:16.888558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:16.889193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:16.889472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:16.889745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:16.890360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:16.891727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:16.900837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:16.901933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:16.903477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 483/957] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:16.908218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:16.995260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:17.015826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad350db-f86b-40b9-9b82-c678a222b73e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:17.051301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:17.052331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:17.052616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:17.052879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:17.053507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:17.053849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:17.055279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:17.060876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 475/958] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:17.066271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:17.172467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1799d1-88c5-4f1f-b5f8-54dcb4741f84 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:17.211395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6afc1-62ba-4aa2-ad80-8a4bf73bd8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:17.212019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6afc1-62ba-4aa2-ad80-8a4bf73bd8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:17.212316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6afc1-62ba-4aa2-ad80-8a4bf73bd8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:17.212533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6afc1-62ba-4aa2-ad80-8a4bf73bd8a5 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:17.213165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6afc1-62ba-4aa2-ad80-8a4bf73bd8a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:17.213462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6afc1-62ba-4aa2-ad80-8a4bf73bd8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:17.214838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6afc1-62ba-4aa2-ad80-8a4bf73bd8a5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:17.220539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 484/959] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:17.225857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:17.331204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace9f02-6b71-4a88-b218-804e87116f4c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:17.366236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ecad-d400-4021-aacd-242d020af6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:17.366846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ecad-d400-4021-aacd-242d020af6c0 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:17.367123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ecad-d400-4021-aacd-242d020af6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:17.367392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ecad-d400-4021-aacd-242d020af6c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:17.368056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7ecad-d400-4021-aacd-242d020af6c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:17.369422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7ecad-d400-4021-aacd-242d020af6c0 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:17.386089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:17.391634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 476/960] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:16:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:17.842508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405adf1-42a6-423f-922d-2901f4da6957 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:17.842796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405adf1-42a6-423f-922d-2901f4da6957 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:17.843076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405adf1-42a6-423f-922d-2901f4da6957 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:17.844716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 485/961] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:17.850831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547ef0-7ad3-483b-88cd-08c116fbbbf8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:17.851121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547ef0-7ad3-483b-88cd-08c116fbbbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:17.851402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547ef0-7ad3-483b-88cd-08c116fbbbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:17.869873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1b547ef0-7ad3-483b-88cd-08c116fbbbf8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:17.871099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1b547ef0-7ad3-483b-88cd-08c116fbbbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:17.951341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 477/962] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:18.230736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405adf1-42a6-423f-922d-2901f4da6957 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:18.269349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:18.342596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405adf1-42a6-423f-922d-2901f4da6957 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:18.382269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:18.383274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:18.383893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:18.384646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:18.385952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:18.387640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:18.410973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.sql.core [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 19:16:18.410973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 19:16:18.410973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [parameters: {'user_id': '661442215dd04ae784f38c5f0037cb9b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 19:16:18.410973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 30 19:16:18.418996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 19:16:18.419884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application yield resource Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.rollback() Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.force_reraise() Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise self.value Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application session.commit() Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 30 19:16:18.420841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._prepare_impl() Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.flush() Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._flush(objects) Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application compat.raise_( Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application flush_context.execute() Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rec.execute(self) Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 30 19:16:18.421785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 30 19:16:18.423375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 30 19:16:18.424249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [parameters: {'user_id': '661442215dd04ae784f38c5f0037cb9b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:18.425112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 30 19:16:18.427655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 30 19:16:18.429762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 30 19:16:18.429762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 30 19:16:18.429762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 30 19:16:18.429762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 30 19:16:18.429762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 30 19:16:18.429762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:18.432506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 486/963] 10.222.0.18 () {60 vars in 1131 bytes} [Fri Sep 30 19:16:18 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:18.438205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b547ef0-7ad3-483b-88cd-08c116fbbbf8 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:18.554286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b547ef0-7ad3-483b-88cd-08c116fbbbf8 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:18.581886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:18.591658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b059ee-e1a0-4597-8e8d-0bb84a0c0f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:18.592498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b059ee-e1a0-4597-8e8d-0bb84a0c0f8d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:18.592918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b059ee-e1a0-4597-8e8d-0bb84a0c0f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:18.593328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b059ee-e1a0-4597-8e8d-0bb84a0c0f8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:18.601703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b059ee-e1a0-4597-8e8d-0bb84a0c0f8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:18.603344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b059ee-e1a0-4597-8e8d-0bb84a0c0f8d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b3b059ee-e1a0-4597-8e8d-0bb84a0c0f8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:18.615624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:18.616788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 30 19:16:18.617955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:18.620170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 478/964] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:16:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:18.628026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:18.634740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8918ce-85ea-4d41-9767-a9c175c3e321 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:18.635210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8918ce-85ea-4d41-9767-a9c175c3e321 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:18.635626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8918ce-85ea-4d41-9767-a9c175c3e321 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:18.637387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 479/965] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:18.642185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe022af-2f0e-405a-820d-f8d2111cabcc None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:18.642754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe022af-2f0e-405a-820d-f8d2111cabcc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:18.643769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe022af-2f0e-405a-820d-f8d2111cabcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:18.668761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-abe022af-2f0e-405a-820d-f8d2111cabcc None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:18.670307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-abe022af-2f0e-405a-820d-f8d2111cabcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:18.737441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:18.745393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e64e5-e712-4479-a31d-9413301405dc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:18.758657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 480/966] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:18.791179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6685e8-2159-4d50-b3d6-cc8a26d8182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:18.792010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6685e8-2159-4d50-b3d6-cc8a26d8182f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:18.792457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6685e8-2159-4d50-b3d6-cc8a26d8182f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:18.792868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6685e8-2159-4d50-b3d6-cc8a26d8182f None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:18.793697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6685e8-2159-4d50-b3d6-cc8a26d8182f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:18.794157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6685e8-2159-4d50-b3d6-cc8a26d8182f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:18.795970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6685e8-2159-4d50-b3d6-cc8a26d8182f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:18.839443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 487/967] 10.222.0.18 () {56 vars in 1101 bytes} [Fri Sep 30 19:16:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:18.930937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4de7f-6b81-4c30-bf82-a08a3090d52b None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:18.931229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4de7f-6b81-4c30-bf82-a08a3090d52b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:18.931509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4de7f-6b81-4c30-bf82-a08a3090d52b None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:18.933231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 481/968] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:18.939207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c14dac-1602-41c7-bde0-dd0df74b18bd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:18.939499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c14dac-1602-41c7-bde0-dd0df74b18bd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:18.939780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c14dac-1602-41c7-bde0-dd0df74b18bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:18.960768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-05c14dac-1602-41c7-bde0-dd0df74b18bd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:18.962420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-05c14dac-1602-41c7-bde0-dd0df74b18bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:19.037473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4de7f-6b81-4c30-bf82-a08a3090d52b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:19.060731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 488/969] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:19.162925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4de7f-6b81-4c30-bf82-a08a3090d52b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:19.181143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:19.200043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:19.200674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.200951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.201222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.212158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:19.216948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:19.217875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:19.219408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 482/970] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 30 19:16:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:19.223929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c14dac-1602-41c7-bde0-dd0df74b18bd None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:19.311853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:19.329849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c14dac-1602-41c7-bde0-dd0df74b18bd None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:19.333273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:19.382336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:19.383467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.384024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.384024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.384695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:19.384998 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:19.387910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:19.399154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 489/971] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 30 19:16:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:19.404813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:19.452665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54211bb4-c1c8-4a9e-9557-2cdb7ac820b1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:19.489357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:19.490009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.490318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.490598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.491247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:19.492624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:19.510177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 483/972] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:16:19 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:19.523674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978e9cd-c376-4a2b-a1b4-e2189298e3fa None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:19.574437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c32e00-1357-45df-8711-be3dc45d329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:19.575482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32e00-1357-45df-8711-be3dc45d329e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.575978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32e00-1357-45df-8711-be3dc45d329e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.576443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c32e00-1357-45df-8711-be3dc45d329e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.590139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c32e00-1357-45df-8711-be3dc45d329e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:19.591903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c32e00-1357-45df-8711-be3dc45d329e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:19.594293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d1c32e00-1357-45df-8711-be3dc45d329e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:19.609914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:19.610989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:19.612406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:19.612406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:19.612406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:19.612406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 490/973] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:19.617848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:19.663356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:19.683573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cc2e0-b06e-4360-b2a4-3c647154ba38 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.684191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cc2e0-b06e-4360-b2a4-3c647154ba38 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.684191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cc2e0-b06e-4360-b2a4-3c647154ba38 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.685806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 491/974] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:19.691506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f91b-f9f7-40f1-843d-aeebe0cc119c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.691951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f91b-f9f7-40f1-843d-aeebe0cc119c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.692439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277f91b-f9f7-40f1-843d-aeebe0cc119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.711939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8277f91b-f9f7-40f1-843d-aeebe0cc119c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:19.713053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8277f91b-f9f7-40f1-843d-aeebe0cc119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:19.744459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf5e8a-4104-4540-be1e-b50c9cb9f28b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:19.780225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:19.780843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.781126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.781403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.782045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:19.782374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:19.783747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:19.796498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 492/975] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:19.801476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 484/976] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:19.803267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277f91b-f9f7-40f1-843d-aeebe0cc119c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:19.908612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277f91b-f9f7-40f1-843d-aeebe0cc119c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:19.933025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:19.945155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:19.945781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:19.946080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:19.946344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:19.953504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:19.954946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:19.967423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:19.968406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:19.974833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 493/977] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:16:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:19.975483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.068298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.081028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:20.088009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258e749-a099-4cb9-8d12-a818504fa2e3 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.127180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.127786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.128056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.128332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.129203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:20.129498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.130960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.151160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 485/978] 10.222.0.18 () {56 vars in 1149 bytes} [Fri Sep 30 19:16:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:20.156724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.185753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adbbd9-be26-48e2-91f1-ad569b28d2b2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.223247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.223905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.224188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.224484 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.225040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.226441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:20.236439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:20.237469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:20.238957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 494/979] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:20.244313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.261414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc09b15-7339-49e4-998b-eee1708a1603 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.295772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.296375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.296647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.296915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.299860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:20.323716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:20.359100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010740-e82b-49e5-874d-cbcaa515de56 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.372962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.374760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.397759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.398403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.398695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.398962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.399592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:20.399899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.401266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.406456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 495/980] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:20.412561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.493419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 486/981] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:20.499210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.536342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff3a5c-9378-4834-b9f8-973d6b03176d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.552559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:20.556141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:20.577071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.577681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.577965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.578260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.578889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:20.579195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.580551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.590096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 496/982] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:20.591547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.607690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f823a-5602-4816-b454-2c49de5ff41f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.646663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.647721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.648004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.648543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.661731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.663206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:20.678547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:20.679536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:20.680467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:20.680467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:20.680467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:20.680467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 487/983] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:20.685119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.699175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9e62b-4b4d-45b7-b898-fbd386150768 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.746773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.747775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.748262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.748735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.749656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] RBAC: Adding query filter params (interface=admin, service_id=a2ae5af59b0d4cb7be5db7eb193f07b6, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:20.750352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.752486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.759112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 497/984] 10.222.0.18 () {56 vars in 1249 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/endpoints?service_id=a2ae5af59b0d4cb7be5db7eb193f07b6&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:20.764481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.809154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:20.811693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866b32e-1fdd-4ac7-ba42-17700b487a61 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.820617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:20.849722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.850370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.850647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.850918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.851556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:20.851855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.853297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.865429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 488/985] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:20.870956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:20.875671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f335a3d-8015-4bbd-94da-e80691d6e853 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:20.912240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:20.912930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:20.913279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:20.913621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:20.914323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:20.915756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:20.922382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 498/986] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:16:20.977283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47396-460c-4d8a-b676-7f170eca9066 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:21.015021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:21.015583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:21.015862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:21.016134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:21.024234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:21.025714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:21.038307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:21.039347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:21.040278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:21.043270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 489/987] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:21.052152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:21.170675 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3856-fe1f-4120-b64b-d929bb4077f4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:21.173794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:21.206402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd17100-f348-44b4-8b34-1b95835569a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:21.207683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17100-f348-44b4-8b34-1b95835569a2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:21.208122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17100-f348-44b4-8b34-1b95835569a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:21.208395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd17100-f348-44b4-8b34-1b95835569a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:21.209082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd17100-f348-44b4-8b34-1b95835569a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:21.209385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd17100-f348-44b4-8b34-1b95835569a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:21.210824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd17100-f348-44b4-8b34-1b95835569a2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:21.229109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 499/988] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:21.230079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:21.259982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:21.333404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00998112-5351-42c0-93cc-2ebe01a971bc None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:21.368170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b9108-fb70-43b2-b64d-7fc4cfa632da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:21.368945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9108-fb70-43b2-b64d-7fc4cfa632da None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:21.369226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9108-fb70-43b2-b64d-7fc4cfa632da None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:21.369497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b9108-fb70-43b2-b64d-7fc4cfa632da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:21.370245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b9108-fb70-43b2-b64d-7fc4cfa632da None admin] RBAC: Adding query filter params (role.id=c5fe7d00f1084287a9614fdc023f9f64, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=a2d7f47c973449069def6cc121df83f1) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:21.370555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b9108-fb70-43b2-b64d-7fc4cfa632da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:21.372026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b9108-fb70-43b2-b64d-7fc4cfa632da None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:21.386094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 490/989] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:21 2022] GET /identity/v3/role_assignments?user.id=a2d7f47c973449069def6cc121df83f1&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=c5fe7d00f1084287a9614fdc023f9f64 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:21.787386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec29f1c-2b16-4969-bf4f-0334d4948f1b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:21.787901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec29f1c-2b16-4969-bf4f-0334d4948f1b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:21.787901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec29f1c-2b16-4969-bf4f-0334d4948f1b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:21.789356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 500/990] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:21.794583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d037-4fcd-4e08-b997-505e3efc5d4f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:21.794877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d037-4fcd-4e08-b997-505e3efc5d4f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:21.795156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d037-4fcd-4e08-b997-505e3efc5d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:21.814359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2c76d037-4fcd-4e08-b997-505e3efc5d4f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:21.815604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2c76d037-4fcd-4e08-b997-505e3efc5d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:21.886924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 491/991] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:22.161840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec29f1c-2b16-4969-bf4f-0334d4948f1b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:22.267173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec29f1c-2b16-4969-bf4f-0334d4948f1b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:22.302723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:22.303347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:22.303622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:22.303892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:22.304460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:22.305802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:22.314720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:22.315845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:22.317445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:22.319106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 501/992] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:22.322666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d037-4fcd-4e08-b997-505e3efc5d4f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:22.345489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:22.428099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d037-4fcd-4e08-b997-505e3efc5d4f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:22.461343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:22.461950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:22.462259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:22.462533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:22.463157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:22.463461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:22.464841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:22.474836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 492/993] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:16:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:22.476119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:22.505955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:22.580323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1338db-3c51-49c5-9311-b2885e93b155 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:22.614303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:22.614902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:22.615178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:22.615448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:22.616062 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:22.616359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:22.617716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:22.626454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 502/994] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:16:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:22.628817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:22.717813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:22.735224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1b0eb-5392-4a22-b926-8c559f3339fc None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:22.770632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0431d-ed2a-48a9-9008-c22f5e641c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:22.771230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0431d-ed2a-48a9-9008-c22f5e641c75 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:22.771504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0431d-ed2a-48a9-9008-c22f5e641c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:22.771769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0431d-ed2a-48a9-9008-c22f5e641c75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:22.772451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0431d-ed2a-48a9-9008-c22f5e641c75 None admin] RBAC: Adding query filter params (interface=public, service_id=dac8a9305f9f4ce5a319e976a580e920, region_id=RegionOne) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:22.772754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0431d-ed2a-48a9-9008-c22f5e641c75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:22.774138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0431d-ed2a-48a9-9008-c22f5e641c75 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:22.781962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 493/995] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:16:22 2022] GET /identity/v3/endpoints?service_id=dac8a9305f9f4ce5a319e976a580e920&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:22.785606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:22.877106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:22.887555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cf28b-4733-4de0-a868-c50ac6191ad3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:22.921328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496b79-46df-43f5-b258-84a0ffe4d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:22.922010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496b79-46df-43f5-b258-84a0ffe4d535 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:22.922391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496b79-46df-43f5-b258-84a0ffe4d535 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:22.922720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496b79-46df-43f5-b258-84a0ffe4d535 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:22.923378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496b79-46df-43f5-b258-84a0ffe4d535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:22.924788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496b79-46df-43f5-b258-84a0ffe4d535 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:22.934221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 503/996] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:16:22 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:16:23.102526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a6d36-4a2c-45dc-addb-1f851da07308 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:23.102852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a6d36-4a2c-45dc-addb-1f851da07308 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:23.103076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a6d36-4a2c-45dc-addb-1f851da07308 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:23.104548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 494/997] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:23.109837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5b8fc-80f2-4afb-be2f-e7df23bf9144 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:23.110279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5b8fc-80f2-4afb-be2f-e7df23bf9144 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:23.110566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5b8fc-80f2-4afb-be2f-e7df23bf9144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:23.130562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-81f5b8fc-80f2-4afb-be2f-e7df23bf9144 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:23.131666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-81f5b8fc-80f2-4afb-be2f-e7df23bf9144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:23.198219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 504/998] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:23.486330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a6d36-4a2c-45dc-addb-1f851da07308 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:23.594662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a6d36-4a2c-45dc-addb-1f851da07308 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:23.640633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ad05c-fd94-48b0-b505-cf956c22bad3 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:23.643250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ad05c-fd94-48b0-b505-cf956c22bad3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:23.643250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ad05c-fd94-48b0-b505-cf956c22bad3 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:23.643250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 505/999] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:23.645604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:23.646276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:23.646554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:23.647989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dfefe-7988-4e1a-a455-89f27beaad25 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:23.654084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dfefe-7988-4e1a-a455-89f27beaad25 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:23.654084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172dfefe-7988-4e1a-a455-89f27beaad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:23.658082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:23.658082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:23.658082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:23.669315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:23.675359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 30 19:16:23.676461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:23.677321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-172dfefe-7988-4e1a-a455-89f27beaad25 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:23.677400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 495/1000] 10.222.0.18 () {56 vars in 1126 bytes} [Fri Sep 30 19:16:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:23.677479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-172dfefe-7988-4e1a-a455-89f27beaad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:23.679258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:23.696692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:23.767477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 506/1001] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:23.808967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e15f-818d-445d-9f6f-1822df9c2e10 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:23.845231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:23.845849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:23.846152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:23.846425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:23.847091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:23.847956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:23.849337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:23.859151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 496/1002] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:23.861427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dfefe-7988-4e1a-a455-89f27beaad25 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:23.880827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:23.968249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172dfefe-7988-4e1a-a455-89f27beaad25 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:24.007895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:24.008958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:24.009439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:24.009910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:24.010856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:24.011414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:24.013132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:24.020537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 507/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Fri Sep 30 19:16:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:24.026376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:24.044595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:24.113651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:24.132117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:24.137471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f08a8-7cf7-4af6-b63c-8148698e678a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:24.157395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e5a90-66f8-45b8-84af-16bb02e153ca None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:24.174643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:24.176175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:24.176610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:24.177032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:24.177882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:24.179423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:24.195833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:24.196500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:24.196763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:24.197012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] PATH_INFO: `/v3/services/image` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:24.197832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:24.197961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 497/1004] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:16:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:24.199166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:24.209544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:24.214458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:24.215419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 508/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Sep 30 19:16:24 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:24.217417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:24.338311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51cd23-d518-4fe4-87d8-b3ab1b3a1899 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:24.371285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:24.380265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd472496-70b6-42af-95b9-613ed7084412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:24.381355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472496-70b6-42af-95b9-613ed7084412 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:24.381355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472496-70b6-42af-95b9-613ed7084412 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:24.381557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472496-70b6-42af-95b9-613ed7084412 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:24.382328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd472496-70b6-42af-95b9-613ed7084412 None admin] RBAC: Adding query filter params (name=image) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:24.382456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd472496-70b6-42af-95b9-613ed7084412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:24.383735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd472496-70b6-42af-95b9-613ed7084412 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:24.388746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 498/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:24.395180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:24.500295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a78ae-4898-4f97-b9ff-c80fa6e0034d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:24.536707 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d327-f2ee-4173-a878-d39e991b54d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:24.537315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d327-f2ee-4173-a878-d39e991b54d2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:24.537594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d327-f2ee-4173-a878-d39e991b54d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:24.537867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d327-f2ee-4173-a878-d39e991b54d2 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:24.538536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d327-f2ee-4173-a878-d39e991b54d2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:24.538843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d327-f2ee-4173-a878-d39e991b54d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:24.540210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022d327-f2ee-4173-a878-d39e991b54d2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:24.544944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 509/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:25.130368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423a1e-0f56-44f8-a2e3-3684a7631965 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:25.130919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423a1e-0f56-44f8-a2e3-3684a7631965 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:25.130919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423a1e-0f56-44f8-a2e3-3684a7631965 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:25.132389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 499/1008] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:25.137258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cb00-5c62-4ca7-a02e-d7a366593e80 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:25.137633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cb00-5c62-4ca7-a02e-d7a366593e80 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:25.137796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cb00-5c62-4ca7-a02e-d7a366593e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:25.156458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3f69cb00-5c62-4ca7-a02e-d7a366593e80 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:25.157645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3f69cb00-5c62-4ca7-a02e-d7a366593e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:25.160777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:25.228453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 510/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:25.502142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4423a1e-0f56-44f8-a2e3-3684a7631965 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:25.608219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4423a1e-0f56-44f8-a2e3-3684a7631965 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:25.642682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:25.643309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:25.643592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:25.643904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:25.644620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:25.645989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:25.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:25.655769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 30 19:16:25.656642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:25.658371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 500/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:25.661847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cb00-5c62-4ca7-a02e-d7a366593e80 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:25.762655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cb00-5c62-4ca7-a02e-d7a366593e80 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:25.798662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:25.799298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:25.799582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:25.799856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:25.800713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:25.801020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:25.802456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:25.812216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 511/1011] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:16:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:25.813161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:25.875638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:25.918457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d5ab4-2224-4a81-8684-3ee52512dc4d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:25.952317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94981e-35c3-414b-8dd7-85df95f0704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:25.953259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94981e-35c3-414b-8dd7-85df95f0704a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:25.953731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94981e-35c3-414b-8dd7-85df95f0704a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:25.954217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94981e-35c3-414b-8dd7-85df95f0704a None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:25.955048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94981e-35c3-414b-8dd7-85df95f0704a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:25.955543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94981e-35c3-414b-8dd7-85df95f0704a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:25.957225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94981e-35c3-414b-8dd7-85df95f0704a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:25.966573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 501/1012] 10.222.0.18 () {56 vars in 1112 bytes} [Fri Sep 30 19:16:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:25.968144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:25.971293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:26.072037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79e437-90e3-4eef-9df5-9bc57347a05f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:26.107916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06f7a9-90fd-4e83-afb5-57c17395c121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:26.108527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f7a9-90fd-4e83-afb5-57c17395c121 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:26.108804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f7a9-90fd-4e83-afb5-57c17395c121 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:26.109073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06f7a9-90fd-4e83-afb5-57c17395c121 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:26.109729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f7a9-90fd-4e83-afb5-57c17395c121 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:26.111145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06f7a9-90fd-4e83-afb5-57c17395c121 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:26.138086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 512/1013] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:16:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:26.384163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a1847-acc8-485e-853b-d5d87ad640d8 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:26.384682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a1847-acc8-485e-853b-d5d87ad640d8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:26.384682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a1847-acc8-485e-853b-d5d87ad640d8 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:26.385941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 502/1014] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:26.391189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec422-5fbf-4ab4-929d-8f835dead0f5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:26.391477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec422-5fbf-4ab4-929d-8f835dead0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:26.391750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec422-5fbf-4ab4-929d-8f835dead0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:26.410159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-578ec422-5fbf-4ab4-929d-8f835dead0f5 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:26.411343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-578ec422-5fbf-4ab4-929d-8f835dead0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:26.467361 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:26.489906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 513/1015] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:26 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:26.728234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503ccb-89a8-4641-a9f0-4c00e75ad2bf None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:26.728586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503ccb-89a8-4641-a9f0-4c00e75ad2bf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:26.728692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503ccb-89a8-4641-a9f0-4c00e75ad2bf None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:26.730211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 503/1016] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:26.735470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f0b6c-c91a-4a1e-8a60-be8cbac8256f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:26.735765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f0b6c-c91a-4a1e-8a60-be8cbac8256f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:26.736048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f0b6c-c91a-4a1e-8a60-be8cbac8256f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:26.755122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503ccb-89a8-4641-a9f0-4c00e75ad2bf None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:26.755437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-266f0b6c-c91a-4a1e-8a60-be8cbac8256f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:26.756630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-266f0b6c-c91a-4a1e-8a60-be8cbac8256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:26.833460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 514/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:26 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:26.861180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503ccb-89a8-4641-a9f0-4c00e75ad2bf None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:26.886257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:26.897351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:26.897974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:26.898283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:26.898551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:26.899644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:26.901072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:26.902807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 504/1018] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:26.908262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f0b6c-c91a-4a1e-8a60-be8cbac8256f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:27.009222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f0b6c-c91a-4a1e-8a60-be8cbac8256f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:27.023823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:27.044923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbe59c-8fc8-479e-a8c4-98411d74aaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:27.045523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbe59c-8fc8-479e-a8c4-98411d74aaa3 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:27.045797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbe59c-8fc8-479e-a8c4-98411d74aaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:27.046088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbe59c-8fc8-479e-a8c4-98411d74aaa3 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:27.046738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbe59c-8fc8-479e-a8c4-98411d74aaa3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:27.048142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbe59c-8fc8-479e-a8c4-98411d74aaa3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:27.078218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 515/1019] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:16:26 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:27.105622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:27.218591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480f239-cbe4-4d26-9501-6c958c1e67e3 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:27.256639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de047a0-700f-4fd5-b880-423481d41c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:27.257251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de047a0-700f-4fd5-b880-423481d41c67 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:27.257519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de047a0-700f-4fd5-b880-423481d41c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:27.257793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de047a0-700f-4fd5-b880-423481d41c67 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:27.258537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de047a0-700f-4fd5-b880-423481d41c67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:27.259953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de047a0-700f-4fd5-b880-423481d41c67 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:27.276893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 505/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:16:27 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:28.439060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048adc-947b-4f03-914c-6ebba1c15f6d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:28.439550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048adc-947b-4f03-914c-6ebba1c15f6d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:28.439550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b048adc-947b-4f03-914c-6ebba1c15f6d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:28.441756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 516/1021] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:28.447477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248bb50-8c8a-4687-8411-504d5794014f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:28.447905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248bb50-8c8a-4687-8411-504d5794014f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:28.448035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248bb50-8c8a-4687-8411-504d5794014f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:28.467092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3248bb50-8c8a-4687-8411-504d5794014f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:28.468275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3248bb50-8c8a-4687-8411-504d5794014f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:28.516760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:28.545101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 506/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:28.824340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b048adc-947b-4f03-914c-6ebba1c15f6d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:28.929078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b048adc-947b-4f03-914c-6ebba1c15f6d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:28.963454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:28.964091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:28.964376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:28.964648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:28.976067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:28.980889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:28.981860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:28.982773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:28.986381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 517/1023] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 30 19:16:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:28.989026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248bb50-8c8a-4687-8411-504d5794014f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.099283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248bb50-8c8a-4687-8411-504d5794014f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:29.134528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17ad02-fcaf-4be2-82a1-d7019aa4c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:29.135147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ad02-fcaf-4be2-82a1-d7019aa4c44d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.135438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ad02-fcaf-4be2-82a1-d7019aa4c44d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.135693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17ad02-fcaf-4be2-82a1-d7019aa4c44d None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.136356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ad02-fcaf-4be2-82a1-d7019aa4c44d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:29.136657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ad02-fcaf-4be2-82a1-d7019aa4c44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:29.138031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17ad02-fcaf-4be2-82a1-d7019aa4c44d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:29.151656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 507/1024] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 30 19:16:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:29.153227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.182930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:29.264458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7122cc8-61d6-45df-aa68-40f7af501d73 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:29.299301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cef1a-2d4c-45d6-844c-b1ff39750c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:29.300559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cef1a-2d4c-45d6-844c-b1ff39750c66 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.301061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cef1a-2d4c-45d6-844c-b1ff39750c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.301382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cef1a-2d4c-45d6-844c-b1ff39750c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.312249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cef1a-2d4c-45d6-844c-b1ff39750c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:29.313696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cef1a-2d4c-45d6-844c-b1ff39750c66 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-707cef1a-2d4c-45d6-844c-b1ff39750c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:29.328205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:29.329232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:29.335428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:29.335428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:29.335428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:29.335661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee1e9-125a-43be-8e21-3cc298c68391 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.335661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee1e9-125a-43be-8e21-3cc298c68391 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.335661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fee1e9-125a-43be-8e21-3cc298c68391 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.335889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 518/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:29.335973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 508/1026] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:29.336131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462effc-d9a0-4d12-bffb-c3442f3f2c32 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.336447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462effc-d9a0-4d12-bffb-c3442f3f2c32 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.336690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462effc-d9a0-4d12-bffb-c3442f3f2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.337454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee1e9-125a-43be-8e21-3cc298c68391 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.359505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d462effc-d9a0-4d12-bffb-c3442f3f2c32 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:29.360648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d462effc-d9a0-4d12-bffb-c3442f3f2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:29.391359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:29.435554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 519/1027] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:29.463160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fee1e9-125a-43be-8e21-3cc298c68391 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:29.470986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119454b-a815-4378-9e16-70810b1be2ab None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.471470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119454b-a815-4378-9e16-70810b1be2ab None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.472193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119454b-a815-4378-9e16-70810b1be2ab None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.473413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 520/1028] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:29.478488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc206-9bed-494b-ab19-b1cf94c4ed40 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.478774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc206-9bed-494b-ab19-b1cf94c4ed40 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.479045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffc206-9bed-494b-ab19-b1cf94c4ed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.497362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4fffc206-9bed-494b-ab19-b1cf94c4ed40 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:29.498745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4fffc206-9bed-494b-ab19-b1cf94c4ed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:29.501121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:29.501536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:29.502228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.503749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.504035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.504730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:29.504969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:29.506394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:29.520287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 509/1029] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:29.527506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.586082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 521/1030] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:29.630982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:29.634432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb1f25-af9a-4681-b49b-369059394248 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:29.669614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:29.670268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.670550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.670825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.677929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:29.679419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:29.691814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:29.692778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:29.693774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 510/1031] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:16:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:29.699929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc206-9bed-494b-ab19-b1cf94c4ed40 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.712988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.809827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffc206-9bed-494b-ab19-b1cf94c4ed40 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:29.827106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f25411-9f72-415f-8316-f41fe0bc7a1e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:29.847316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:29.848011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.848291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.848563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.849294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:29.849600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:29.851061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:29.859168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:29.864617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:29.865244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:29.865519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:29.865787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:29.866904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:29.868329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:29.869943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 511/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:29.870742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.875589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 522/1033] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:16:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:29.876753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:29.903181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:29.974508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d887e89-08d4-4640-9fbb-439f98ace161 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:29.977670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a377d-156a-4d49-8f33-d17c53374890 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.008201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.008825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.009114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.009385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] PATH_INFO: `/v3/services/image` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.009959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.011350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.011966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485eb51-0281-4052-8918-34073615309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.012559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485eb51-0281-4052-8918-34073615309e None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.012833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485eb51-0281-4052-8918-34073615309e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.013098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485eb51-0281-4052-8918-34073615309e None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.013732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485eb51-0281-4052-8918-34073615309e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.015149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485eb51-0281-4052-8918-34073615309e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:30.020628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:30.021830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:30.023126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 512/1034] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Sep 30 19:16:29 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:30.025337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.046140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 523/1035] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:16:29 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:30.046140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485eb51-0281-4052-8918-34073615309e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.112915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:30.138548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:30.148847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58e49-acb3-4172-bd67-ebaed421cdea None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.172476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485eb51-0281-4052-8918-34073615309e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.188862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.189491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.189771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.190045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.214539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.215154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.215431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.215698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.216324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] RBAC: Adding query filter params (name=image) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:30.217107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.217981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.225025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 524/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:30.230855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.267619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.269740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.345877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eb153-149d-4266-85b6-5c4f98585550 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.363395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:30.371484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:30.382549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 513/1037] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:30.386022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.386662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.387126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.387374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.387984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.388088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:30.388300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.389786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.395434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 525/1038] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:30.401050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.510005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43807-fb2d-4e37-94e6-fb71bbffa51c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.517081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334773-1c65-486b-ab26-feae7c28b0c2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.549560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.550543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.551104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.551379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.551572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.552380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.552721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.553303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.554517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] RBAC: Adding query filter params (interface=public, service_id=00bd08032b33413f8e4a70c25c1d51ad, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:30.554831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.557835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.563301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.564759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.565062 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 526/1039] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/endpoints?service_id=00bd08032b33413f8e4a70c25c1d51ad&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:30.569796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:30.584209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:30.586792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:30.587753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:30.587753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:30.587753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:30.587753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 514/1040] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:30.590923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.623716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:30.641465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:30.683904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ec88-c9c4-4fa7-9be1-9905af2d6cc3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.708389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6151599-b58a-43b4-a8d5-8bade205daf4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.721693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.724035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.724035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.724035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.724641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.725997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.732939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 527/1041] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:16:30.747777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.748421 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.748705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.748984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.749659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:30.749970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.751836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.766752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 515/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:30.774172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:30.891135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8093132-96a4-4d22-9c6b-6ede8b2eb94f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:30.901841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:30.929398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:30.930034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:30.930336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:30.930605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:30.937377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:30.938832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:30.950287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:30.951247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:30.952159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 528/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:30.959741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:31.070268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eb11b-bd5a-4856-9c5a-960c16d1938a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:31.073607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:31.107344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a08946-746d-43f7-a6f0-c22d93ddd4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:31.107952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a08946-746d-43f7-a6f0-c22d93ddd4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:31.108230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a08946-746d-43f7-a6f0-c22d93ddd4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:31.108502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a08946-746d-43f7-a6f0-c22d93ddd4d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:31.109190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a08946-746d-43f7-a6f0-c22d93ddd4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:31.109522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a08946-746d-43f7-a6f0-c22d93ddd4d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:31.110979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a08946-746d-43f7-a6f0-c22d93ddd4d4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:31.128825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 516/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:31.129876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:31.232696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602a5d-a5f8-484c-b5aa-d45147de4945 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:31.266802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9925f-dd1c-4e2f-ac0b-1ff563e68251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:31.267406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9925f-dd1c-4e2f-ac0b-1ff563e68251 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:31.267687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9925f-dd1c-4e2f-ac0b-1ff563e68251 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:31.267962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9925f-dd1c-4e2f-ac0b-1ff563e68251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:31.268774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9925f-dd1c-4e2f-ac0b-1ff563e68251 None admin] RBAC: Adding query filter params (role.id=c5fe7d00f1084287a9614fdc023f9f64, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=57667fb21646457b8871087abcbd978c) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:31.269094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9925f-dd1c-4e2f-ac0b-1ff563e68251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:31.270544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9925f-dd1c-4e2f-ac0b-1ff563e68251 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:31.282108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 529/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:31 2022] GET /identity/v3/role_assignments?user.id=57667fb21646457b8871087abcbd978c&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=c5fe7d00f1084287a9614fdc023f9f64 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:32.310704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f009-bc47-4795-ab73-e2ed12ef59b4 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:32.311217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f009-bc47-4795-ab73-e2ed12ef59b4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:32.311298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6f009-bc47-4795-ab73-e2ed12ef59b4 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:32.312801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 517/1046] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:32.318319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f316a8-8fe5-4929-82e2-bbbc5f41ed8a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:32.318727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f316a8-8fe5-4929-82e2-bbbc5f41ed8a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:32.318914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f316a8-8fe5-4929-82e2-bbbc5f41ed8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:32.337752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c5f316a8-8fe5-4929-82e2-bbbc5f41ed8a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:32.338994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c5f316a8-8fe5-4929-82e2-bbbc5f41ed8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:32.365355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:32.408312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 530/1047] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:32.678340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6f009-bc47-4795-ab73-e2ed12ef59b4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:32.787988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6f009-bc47-4795-ab73-e2ed12ef59b4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:32.825135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fee7e1-3b5c-4af4-be5a-ddf698a0482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:32.825817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fee7e1-3b5c-4af4-be5a-ddf698a0482d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:32.826122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fee7e1-3b5c-4af4-be5a-ddf698a0482d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:32.826400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fee7e1-3b5c-4af4-be5a-ddf698a0482d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:32.838332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fee7e1-3b5c-4af4-be5a-ddf698a0482d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-11fee7e1-3b5c-4af4-be5a-ddf698a0482d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:32.843055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:32.844026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:32.848010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 518/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:32.851515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f316a8-8fe5-4929-82e2-bbbc5f41ed8a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:32.895007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4efe-372f-404f-92f9-ca929e7542d9 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:32.895334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4efe-372f-404f-92f9-ca929e7542d9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:32.895550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4efe-372f-404f-92f9-ca929e7542d9 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:32.896875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 519/1049] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:32.901763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de249bb-d548-47e8-bfe3-ffd8fe512282 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:32.902037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de249bb-d548-47e8-bfe3-ffd8fe512282 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:32.902339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de249bb-d548-47e8-bfe3-ffd8fe512282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:32.920885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1de249bb-d548-47e8-bfe3-ffd8fe512282 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:32.922070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1de249bb-d548-47e8-bfe3-ffd8fe512282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:32.943322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:32.961663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f316a8-8fe5-4929-82e2-bbbc5f41ed8a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:32.999112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 520/1050] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:33.002242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.002370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.002785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.003080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.003748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:33.004046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.005439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.018608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 531/1051] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:33.020865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de249bb-d548-47e8-bfe3-ffd8fe512282 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.133817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de249bb-d548-47e8-bfe3-ffd8fe512282 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:33.168783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.169415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.169690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.169959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] PATH_INFO: `/v3/users/c3d42f564c1b46fc8114140b227dee96` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.183919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] RBAC: Authorizing `identity:get_user(user_id=c3d42f564c1b46fc8114140b227dee96)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.185398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.192314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 521/1052] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/users/c3d42f564c1b46fc8114140b227dee96 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:33.193684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.219971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:33.265247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.282576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:33.305687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe505f-fb2e-4de3-b0e4-0ed52a0f74e9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:33.348602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b9ba-3fc4-4b99-a69d-921de919db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.349292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b9ba-3fc4-4b99-a69d-921de919db98 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.349533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b9ba-3fc4-4b99-a69d-921de919db98 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.349768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b9ba-3fc4-4b99-a69d-921de919db98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.381190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2191da8-0b1d-4c31-918d-df180dac207c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:33.415662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.416289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.416566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.416833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] PATH_INFO: `/v3/services/image` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.417401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.418783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.422803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86b9ba-3fc4-4b99-a69d-921de919db98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.424222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86b9ba-3fc4-4b99-a69d-921de919db98 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:33.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:33.428682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:33.429987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 522/1053] 10.222.0.18 () {56 vars in 1105 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:33.434432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.453155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:33.510858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:33.530137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 532/1054] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:33.531392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9605702-8084-49f4-b94c-fc919d09a40a None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.531673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9605702-8084-49f4-b94c-fc919d09a40a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.531941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9605702-8084-49f4-b94c-fc919d09a40a None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.533301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 533/1055] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:33.533424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885b24f-722d-4eb6-9bf3-48e41ee40ffa None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:33.537230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9605702-8084-49f4-b94c-fc919d09a40a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.572945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072b7e3-ba8d-4687-8718-0e5035f5e845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.573558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b7e3-ba8d-4687-8718-0e5035f5e845 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.573838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b7e3-ba8d-4687-8718-0e5035f5e845 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.574145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b7e3-ba8d-4687-8718-0e5035f5e845 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.574778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072b7e3-ba8d-4687-8718-0e5035f5e845 None admin] RBAC: Adding query filter params (name=image) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:33.575085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072b7e3-ba8d-4687-8718-0e5035f5e845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.576456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072b7e3-ba8d-4687-8718-0e5035f5e845 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.581357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 523/1056] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:33.582536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decdd6-264f-416c-9733-72f9d9aa897d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.582823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decdd6-264f-416c-9733-72f9d9aa897d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.583097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decdd6-264f-416c-9733-72f9d9aa897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.601368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-77decdd6-264f-416c-9733-72f9d9aa897d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:33.602586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-77decdd6-264f-416c-9733-72f9d9aa897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:33.640965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9605702-8084-49f4-b94c-fc919d09a40a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:33.665097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:33.671338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 524/1057] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:33.672175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77decdd6-264f-416c-9733-72f9d9aa897d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.686874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.687516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.687799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.688068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.689177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] RBAC: Authorizing `identity:get_project(project_id=77e510d7e98d4bb499d5a9b207d57e0b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.691432 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.697973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 534/1058] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:33.699631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.749480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:33.785081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77decdd6-264f-416c-9733-72f9d9aa897d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:33.811251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef72ea-62e7-4b21-a20a-403c89c71025 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:33.822185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.822790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.823074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.823353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.823974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] RBAC: Adding query filter params (type=image) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:33.824278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.825648 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.830753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 525/1059] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:33.836440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.855595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:33.856301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:33.856587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:33.856860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:33.857605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b, user.id=c3d42f564c1b46fc8114140b227dee96) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:33.857976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:33.859497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:33.871854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 535/1060] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/role_assignments?user.id=c3d42f564c1b46fc8114140b227dee96&scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:33.953115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:33.962916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d494b96-dbf9-43e0-8635-38f182916b89 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:34.002279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:34.002880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:34.003149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:34.003419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:34.004101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:34.006228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:34.011919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:34.026818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:34.032553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 526/1061] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:16:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:16:34.089531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0fdef-2ed1-4efc-b3f9-864e15bf5978 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:34.136647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:34.137293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:34.137570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:34.137841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:34.151021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:34.156078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:34.157075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:34.157975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 536/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 30 19:16:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:34.166014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:34.282843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce0a13-f36a-470d-9080-bc279cc497cd None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:34.317345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:34.317954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:34.318260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:34.318531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:34.319192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:34.319523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:34.320860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:34.329549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 527/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 30 19:16:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:34.335906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:34.437788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28426fb-270b-4ad6-9f00-59d84ff9e17b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:34.451428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:34.477963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:34.477963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:34.477963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:34.478571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:34.490622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:34.492110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:34.507303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:34.508288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:34.509209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:34.509209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:34.509209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:34.509209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 537/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:34.514096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:34.571033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:34.622409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6ca83-fa21-405c-a876-4d10f8c18090 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:34.660630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:34.661485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:34.661911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:34.662391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:34.663227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:34.663677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:34.665202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:34.677905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 528/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:34.683605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:34.791202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e535bd-d850-4ceb-ad0e-233044227512 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:34.827487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:34.828039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:34.828320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:34.828595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:34.836971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:34.838434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:34.851947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:34.852976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:16:34.853986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:34.857742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 538/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:16:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:34.859006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:34.965983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22363a-f239-48ca-9327-3a496b82fcbb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:34.979674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:35.002264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:35.003743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:35.004026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:35.004301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:35.005018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:35.005322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:35.006831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:35.029558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 529/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:16:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:35.030566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:35.058084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:35.139108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031ec1a-e14d-4528-b906-4ac9b7a0a835 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:35.175477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:35.177724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:35.177724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:35.177724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:35.188403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:35.189906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:35.204668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:35.206688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:35.207603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:35.207603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:35.207603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:35.210370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 539/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:35.212301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:35.313460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d7f5-5fb4-4b36-9f9f-1280e3ad492e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:35.348136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:35.348740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:35.349025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:35.349294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:35.349926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:35.350255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:35.351622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:35.367684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 530/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:35.369073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:35.459288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:35.484613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb065acc-1747-4f19-9759-76c3597e5d58 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:35.524194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:35.524821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:35.525095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:35.525363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:35.533553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:35.535538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:35.547034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:35.547942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:35.554533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 540/1070] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:35.555068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:35.589236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:35.663659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae411a4-c1ee-4b95-a765-ef3051254eac None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:35.699657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673c14-9468-4c80-a1c1-b9d9df0c68e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:35.700266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673c14-9468-4c80-a1c1-b9d9df0c68e1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:35.700546 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673c14-9468-4c80-a1c1-b9d9df0c68e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:35.700820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673c14-9468-4c80-a1c1-b9d9df0c68e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:35.701508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2673c14-9468-4c80-a1c1-b9d9df0c68e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:35.701815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2673c14-9468-4c80-a1c1-b9d9df0c68e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:35.703275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2673c14-9468-4c80-a1c1-b9d9df0c68e1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:35.720998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 531/1071] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:35.722287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:35.825700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd8449-3a6e-4cfa-ba03-143705b97492 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:35.864258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae20c84-3c18-4845-be82-179c52b85f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:35.864913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae20c84-3c18-4845-be82-179c52b85f0b None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:35.865187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae20c84-3c18-4845-be82-179c52b85f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:35.865453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae20c84-3c18-4845-be82-179c52b85f0b None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/57667fb21646457b8871087abcbd978c/roles/c5fe7d00f1084287a9614fdc023f9f64` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:35.867595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae20c84-3c18-4845-be82-179c52b85f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=57667fb21646457b8871087abcbd978c, role_id=c5fe7d00f1084287a9614fdc023f9f64)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:35.869067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae20c84-3c18-4845-be82-179c52b85f0b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:35.872357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:35.885830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 541/1072] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:16:35 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/57667fb21646457b8871087abcbd978c/roles/c5fe7d00f1084287a9614fdc023f9f64 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:16:36.115375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104ffe-4d43-464c-83ee-16e1e13e529c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:36.115733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104ffe-4d43-464c-83ee-16e1e13e529c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:36.115987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04104ffe-4d43-464c-83ee-16e1e13e529c None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:36.117470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 532/1073] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:36.122713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c475e-6e90-48b4-8e1d-0f08b5e46383 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:36.123002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c475e-6e90-48b4-8e1d-0f08b5e46383 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:36.123297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c475e-6e90-48b4-8e1d-0f08b5e46383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:36.141815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dc2c475e-6e90-48b4-8e1d-0f08b5e46383 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:36.143694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dc2c475e-6e90-48b4-8e1d-0f08b5e46383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:36.228047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 542/1074] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:36.273297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69721e5-eaaa-486a-b526-3707b8da3c47 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:36.273596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69721e5-eaaa-486a-b526-3707b8da3c47 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:36.273843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69721e5-eaaa-486a-b526-3707b8da3c47 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:36.275338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 533/1075] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:36.280333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177ab4-ab7b-491f-bdf6-c3bd0f752081 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:36.280624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177ab4-ab7b-491f-bdf6-c3bd0f752081 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:36.280898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177ab4-ab7b-491f-bdf6-c3bd0f752081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:36.300092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-55177ab4-ab7b-491f-bdf6-c3bd0f752081 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:36.301288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-55177ab4-ab7b-491f-bdf6-c3bd0f752081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:36.368541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 543/1076] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:36.495775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69721e5-eaaa-486a-b526-3707b8da3c47 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:36.595801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:36.608787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69721e5-eaaa-486a-b526-3707b8da3c47 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:36.642023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55177ab4-ab7b-491f-bdf6-c3bd0f752081 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:36.645198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:36.645829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:36.646143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:36.646417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:36.657046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:36.662861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:36.663812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:36.664670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 534/1077] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:36.669764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:36.711852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:36.759079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55177ab4-ab7b-491f-bdf6-c3bd0f752081 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:36.775149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2366ce-427d-4076-ad8d-89c128f0c16a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:36.798490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:36.799803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:36.800302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:36.800783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:36.830786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:36.831583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:36.831872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:36.832145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:36.832841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:36.833148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:36.834558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:36.848656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 535/1078] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:36.849506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:36.865782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:36.886017 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:36.887768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:36.946314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:36.968937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e39c-47e9-4241-888f-ed7eb1887606 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:36.997080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 544/1079] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 19:16:37.003626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:37.007658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:37.008295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:37.008578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:37.008854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] PATH_INFO: `/v3/users/c3d42f564c1b46fc8114140b227dee96` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:37.010000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] RBAC: Authorizing `identity:get_user(user_id=c3d42f564c1b46fc8114140b227dee96)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:37.012000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:37.019411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 536/1080] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:36 2022] GET /identity/v3/users/c3d42f564c1b46fc8114140b227dee96 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:37.020504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:37.118878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:37.122009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba38328-4c0e-4e6d-8dda-297692c5d707 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:37.137503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa65e88-37ff-42c7-a5de-8470a36b7d3d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:37.159658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:37.160279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:37.160563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:37.160832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:37.171434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:37.172862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:37.175251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:37.175912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:37.176188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:37.176462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:37.177558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] RBAC: Authorizing `identity:get_project(project_id=77e510d7e98d4bb499d5a9b207d57e0b)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:37.179018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:37.180795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 537/1081] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:16:37 2022] GET /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:37.186426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:37.191397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:37.192448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:37.193466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:37.193466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:37.193466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:37.193466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 545/1082] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:37.198182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:37.210502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:37.301793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b495468-fb1a-4d85-8d5e-377a54e0cb65 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:37.312775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459bd79-c3a4-46c9-9381-969396aeb3f2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:37.335539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c4bec-2b44-429b-85ec-5e2ddcbdfdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:37.336257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c4bec-2b44-429b-85ec-5e2ddcbdfdf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:37.336467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c4bec-2b44-429b-85ec-5e2ddcbdfdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:37.336736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c4bec-2b44-429b-85ec-5e2ddcbdfdf2 None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b/users/c3d42f564c1b46fc8114140b227dee96/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:37.338620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c4bec-2b44-429b-85ec-5e2ddcbdfdf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=77e510d7e98d4bb499d5a9b207d57e0b, user_id=c3d42f564c1b46fc8114140b227dee96, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:37.340036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c4bec-2b44-429b-85ec-5e2ddcbdfdf2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:37.349491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b843c-def5-414c-9432-5e4f6297e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:37.350128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b843c-def5-414c-9432-5e4f6297e648 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:37.350412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b843c-def5-414c-9432-5e4f6297e648 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:37.350706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b843c-def5-414c-9432-5e4f6297e648 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:37.351359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b843c-def5-414c-9432-5e4f6297e648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:37.351666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b843c-def5-414c-9432-5e4f6297e648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:37.353020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b843c-def5-414c-9432-5e4f6297e648 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:37.355449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 538/1083] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:16:37 2022] PUT /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b/users/c3d42f564c1b46fc8114140b227dee96/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:16:37.373387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 546/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:38.089982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2f32-d1f3-43e8-8916-42e0e3d1056d None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:38.090523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2f32-d1f3-43e8-8916-42e0e3d1056d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:38.090638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f2f32-d1f3-43e8-8916-42e0e3d1056d None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:38.091903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 539/1085] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:38.098287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cdad-5533-4c09-ab3c-284a76318d93 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:38.098706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cdad-5533-4c09-ab3c-284a76318d93 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:38.098839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9cdad-5533-4c09-ab3c-284a76318d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:38.117517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a6d9cdad-5533-4c09-ab3c-284a76318d93 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:38.118722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a6d9cdad-5533-4c09-ab3c-284a76318d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:38.179940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:38.185721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 547/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:38.454621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f2f32-d1f3-43e8-8916-42e0e3d1056d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:38.466486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:38.557593 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f2f32-d1f3-43e8-8916-42e0e3d1056d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:38.591942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:38.592564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:38.592842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:38.593117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:38.603917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:38.608656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:38.609739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:38.610659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 540/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Fri Sep 30 19:16:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:38.616116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9cdad-5533-4c09-ab3c-284a76318d93 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:38.715147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9cdad-5533-4c09-ab3c-284a76318d93 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:38.747790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:38.748391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:38.748672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:38.748945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:38.749605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:38.749908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:38.751570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:38.764584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 548/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 30 19:16:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:38.765728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:38.831399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:38.865440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b92a49-2900-474b-a872-8bbf5622f027 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:38.900544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:38.901178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:38.901459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:38.901733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:38.912529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:38.913987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:38.928071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:38.929244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:38.930629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:38.930629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:38.930629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:38.930629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 541/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:38.934933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:38.993389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:39.034527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5147c1a-6e3a-4993-91e3-8c943d0c6315 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:39.070530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:39.071135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:39.071413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:39.071684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:39.072321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:39.072629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:39.073983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:39.085882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 549/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:39.091479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:39.189174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0639535-297a-4c1d-8fbf-89ab382d5233 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:39.208892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:39.223716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:39.224340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:39.224622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:39.224895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:39.233119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:39.234613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:16:39.246107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:39.247109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 30 19:16:39.248300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:39.250464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 542/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Fri Sep 30 19:16:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:39.253676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:39.349881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3895c8-2d1d-458a-a163-c6cf6862de26 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:39.370748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:39.384823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31fd3a-d29c-4394-bc1a-306e84d558d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:39.385425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31fd3a-d29c-4394-bc1a-306e84d558d6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:39.385702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31fd3a-d29c-4394-bc1a-306e84d558d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:39.385970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31fd3a-d29c-4394-bc1a-306e84d558d6 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:39.386712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31fd3a-d29c-4394-bc1a-306e84d558d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:39.387014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31fd3a-d29c-4394-bc1a-306e84d558d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:39.388423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31fd3a-d29c-4394-bc1a-306e84d558d6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:39.406134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 550/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Fri Sep 30 19:16:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:39.412679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:39.515690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fced9-5e03-421a-8f15-f5db5e08b9b4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:39.526444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e734-0385-47e2-b259-e0e8ff488941 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:39.526729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e734-0385-47e2-b259-e0e8ff488941 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:39.527002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330e734-0385-47e2-b259-e0e8ff488941 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:39.528332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 551/1093] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:16:39.533762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b71a2-eec2-4599-ac09-b6e13e90da85 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:39.534192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b71a2-eec2-4599-ac09-b6e13e90da85 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:39.534677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b71a2-eec2-4599-ac09-b6e13e90da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:39.550636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:39.551240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:39.551517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:39.551789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:39.552837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-199b71a2-eec2-4599-ac09-b6e13e90da85 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:39.554003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-199b71a2-eec2-4599-ac09-b6e13e90da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:39.600195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:39.619971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:39.621359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 552/1094] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:16:39.621479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:39.719890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 543/1095] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:39.727302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b71a2-eec2-4599-ac09-b6e13e90da85 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:39.823432 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b71a2-eec2-4599-ac09-b6e13e90da85 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:39.832364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:39.856266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:39.856879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:39.857154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:39.857423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:39.867584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:39.868992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:16:39.883693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:39.884668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:16:39.885671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:16:39.885671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:16:39.885671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:39.885671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 553/1096] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:39.890410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:39.894481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:39.971952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:39.993594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d30641-3d15-472d-99cb-943c88e69e2e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:39.995678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce8916-62aa-4080-8787-c4139fb96a9d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.028541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.028881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.029145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.029427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.029528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.029701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.029822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.030013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.030368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:40.030714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.032248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.043223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:16:40.045010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 544/1097] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:16:40.048384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:40.049610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:16:40.050522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 554/1098] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:16:40.051231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.056214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.080805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:40.151657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca24d2-e4f6-43d5-a7f0-c88ba965880d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.159561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac81d1-b0eb-4237-9c23-8e79ae2b9241 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.184934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.185557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.185836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.186136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.192520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.193111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.193388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.193493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.193653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.194325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:40.194624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.194872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.195956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.197338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:40.207431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 555/1099] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:16:40.207832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:16:40.208898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:16:40.209816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 545/1100] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:16:40.213447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.214420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.293717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:40.311966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f262c-c212-41f2-bd51-3f8fb7e41433 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.315744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96faaab-00ec-497b-909d-7f703af9a86b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.346161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.346708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.346983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.347245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] PATH_INFO: `/v3/users/c3d42f564c1b46fc8114140b227dee96` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.348340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] RBAC: Authorizing `identity:get_user(user_id=c3d42f564c1b46fc8114140b227dee96)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.349349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.349741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.349950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.350265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.350539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.351225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:40.351338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 556/1101] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/users/c3d42f564c1b46fc8114140b227dee96 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:40.351602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.353095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.356885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.365294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 546/1102] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:40.371044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.430036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:40.459152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78d302-d52b-4078-85f0-eb737ba28021 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.471158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee284fc1-6e8b-44b2-8b01-6a4229fd29b1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.492509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.493109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.493385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.493663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.505098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.505699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.505978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.506283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.507003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] RBAC: Adding query filter params (role.id=c5fe7d00f1084287a9614fdc023f9f64, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=57667fb21646457b8871087abcbd978c) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:40.507355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.508777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.512002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:40.514800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 547/1103] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/role_assignments?user.id=57667fb21646457b8871087abcbd978c&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=c5fe7d00f1084287a9614fdc023f9f64 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:16:40.575211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.576697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.682461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 557/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 19:16:40.688115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.791504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e72fc-acf8-49c0-850f-0519304f214b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.815765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:40.827690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4132b-436d-4894-bd10-3248973fcd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.828315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4132b-436d-4894-bd10-3248973fcd29 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.828591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4132b-436d-4894-bd10-3248973fcd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.828858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4132b-436d-4894-bd10-3248973fcd29 None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.829977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4132b-436d-4894-bd10-3248973fcd29 None admin] RBAC: Authorizing `identity:get_project(project_id=77e510d7e98d4bb499d5a9b207d57e0b)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.831449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4132b-436d-4894-bd10-3248973fcd29 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.833049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 548/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:40.839447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:40.890622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:40.940757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce57e07-aecf-46a7-8de7-dbcc9c4a0313 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:40.975701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9aade6-e979-41d0-a5f2-ecb8fdd61346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:40.976310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aade6-e979-41d0-a5f2-ecb8fdd61346 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:40.976590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aade6-e979-41d0-a5f2-ecb8fdd61346 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:40.976862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9aade6-e979-41d0-a5f2-ecb8fdd61346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:40.977585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aade6-e979-41d0-a5f2-ecb8fdd61346 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b, user.id=c3d42f564c1b46fc8114140b227dee96) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:40.977890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aade6-e979-41d0-a5f2-ecb8fdd61346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:40.979398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9aade6-e979-41d0-a5f2-ecb8fdd61346 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:40.985246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 558/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:40 2022] GET /identity/v3/role_assignments?user.id=c3d42f564c1b46fc8114140b227dee96&scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:43.177570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bcb51-07c1-4372-8572-039f7e3d3bd9 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:43.178130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bcb51-07c1-4372-8572-039f7e3d3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:43.178130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bcb51-07c1-4372-8572-039f7e3d3bd9 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:43.179477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 549/1107] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:43.184709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296e33d-85fa-4d12-be5c-56138aa4e2d4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:43.185115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296e33d-85fa-4d12-be5c-56138aa4e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:43.185261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296e33d-85fa-4d12-be5c-56138aa4e2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:43.203455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8296e33d-85fa-4d12-be5c-56138aa4e2d4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:43.204617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8296e33d-85fa-4d12-be5c-56138aa4e2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:43.269259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 559/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:43.538017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bcb51-07c1-4372-8572-039f7e3d3bd9 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:43.639221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bcb51-07c1-4372-8572-039f7e3d3bd9 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:43.671891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73254967-2fb9-45c9-a138-416ff064dcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:43.672516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254967-2fb9-45c9-a138-416ff064dcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:43.672796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254967-2fb9-45c9-a138-416ff064dcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:43.673067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73254967-2fb9-45c9-a138-416ff064dcd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:43.674836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73254967-2fb9-45c9-a138-416ff064dcd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:43.676340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73254967-2fb9-45c9-a138-416ff064dcd0 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:43.677887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 550/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:43.684092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296e33d-85fa-4d12-be5c-56138aa4e2d4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:43.731917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:43.785046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296e33d-85fa-4d12-be5c-56138aa4e2d4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:43.818291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6b679-2cca-4ea3-b2a2-9306302d4b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:43.818883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b679-2cca-4ea3-b2a2-9306302d4b0b None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:43.819157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b679-2cca-4ea3-b2a2-9306302d4b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:43.819422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b679-2cca-4ea3-b2a2-9306302d4b0b None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:43.820053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6b679-2cca-4ea3-b2a2-9306302d4b0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:43.821463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6b679-2cca-4ea3-b2a2-9306302d4b0b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:43.842063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 560/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:16:43 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:46.087902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661237fb-57cb-4219-935c-7c2b1bafe476 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:46.088365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661237fb-57cb-4219-935c-7c2b1bafe476 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:46.088458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661237fb-57cb-4219-935c-7c2b1bafe476 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:46.089770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 551/1111] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:46.095011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580bee2-b137-4876-a942-7541f6361202 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:46.095498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580bee2-b137-4876-a942-7541f6361202 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:46.095680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580bee2-b137-4876-a942-7541f6361202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:46.113576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8580bee2-b137-4876-a942-7541f6361202 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:46.114810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8580bee2-b137-4876-a942-7541f6361202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:46.179843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 561/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:46.451583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661237fb-57cb-4219-935c-7c2b1bafe476 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:46.510467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:46.552142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661237fb-57cb-4219-935c-7c2b1bafe476 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:46.585133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:46.585754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:46.586036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:46.586338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] PATH_INFO: `/v3/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:46.587713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] RBAC: Authorizing `identity:get_role(role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:46.589085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:46.590428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 552/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:46 2022] GET /identity/v3/roles/e508ed31828645df8c584b7fbe1798e4 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:46.597065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580bee2-b137-4876-a942-7541f6361202 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:46.625491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:46.695132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580bee2-b137-4876-a942-7541f6361202 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:46.728531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:46.729083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:46.729358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:46.729627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] PATH_INFO: `/v3/users/a6803dae92aa4f349f825efdb24da212` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:46.742274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] RBAC: Authorizing `identity:get_user(user_id=a6803dae92aa4f349f825efdb24da212)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:46.743701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:46.745277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 562/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:46 2022] GET /identity/v3/users/a6803dae92aa4f349f825efdb24da212 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:46.751248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:46.849225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b28d1-5380-4d1d-9cb8-f84995a28251 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:46.875886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:46.884786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:46.885414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:46.885654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:46.885923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:46.951807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:46.953302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:47.047589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 553/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:47.053541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:47.137523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:47.149722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d35a1-ad9e-4655-9f7e-d05f43eac50f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:47.181913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0487e-a384-439a-a502-37e22d4c1fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:47.182552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0487e-a384-439a-a502-37e22d4c1fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:47.182828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0487e-a384-439a-a502-37e22d4c1fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:47.183096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0487e-a384-439a-a502-37e22d4c1fc6 None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:47.184183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0487e-a384-439a-a502-37e22d4c1fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=77e510d7e98d4bb499d5a9b207d57e0b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:47.185585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0487e-a384-439a-a502-37e22d4c1fc6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:47.187212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 563/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:16:47 2022] GET /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:47.194288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:47.221525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:47.291399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680494d-b178-49ab-8b0c-88de998dcd7b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:47.324118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fdb73-94a6-4729-b188-1218cef53719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:47.324706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdb73-94a6-4729-b188-1218cef53719 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:47.324979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdb73-94a6-4729-b188-1218cef53719 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:47.325245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdb73-94a6-4729-b188-1218cef53719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:47.325949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fdb73-94a6-4729-b188-1218cef53719 None admin] RBAC: Adding query filter params (role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b, user.id=a6803dae92aa4f349f825efdb24da212) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:47.326284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fdb73-94a6-4729-b188-1218cef53719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:47.327702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fdb73-94a6-4729-b188-1218cef53719 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:47.332981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 554/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:47 2022] GET /identity/v3/role_assignments?user.id=a6803dae92aa4f349f825efdb24da212&scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:49.466626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365f21-aa86-4303-bd35-864ae7552db7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:49.467153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365f21-aa86-4303-bd35-864ae7552db7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:49.467153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365f21-aa86-4303-bd35-864ae7552db7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:49.468408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 564/1118] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:49.473490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dabd4-be0e-4fc9-ba64-f61b1944beaa None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:49.473890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dabd4-be0e-4fc9-ba64-f61b1944beaa None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:49.474034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dabd4-be0e-4fc9-ba64-f61b1944beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:49.492300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ef2dabd4-be0e-4fc9-ba64-f61b1944beaa None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:49.493480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ef2dabd4-be0e-4fc9-ba64-f61b1944beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:49.558119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 555/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:49.830164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365f21-aa86-4303-bd35-864ae7552db7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:49.931612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365f21-aa86-4303-bd35-864ae7552db7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:49.965220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:49.965837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:49.966138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:49.966408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] PATH_INFO: `/v3/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:49.967758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] RBAC: Authorizing `identity:get_role(role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:49.969113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:49.970822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 565/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:49 2022] GET /identity/v3/roles/e508ed31828645df8c584b7fbe1798e4 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:49.976746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dabd4-be0e-4fc9-ba64-f61b1944beaa None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:49.999199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:50.072371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dabd4-be0e-4fc9-ba64-f61b1944beaa None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:50.105813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:50.106403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:50.106686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:50.106956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] PATH_INFO: `/v3/users/a6803dae92aa4f349f825efdb24da212` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:50.108052 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] RBAC: Authorizing `identity:get_user(user_id=a6803dae92aa4f349f825efdb24da212)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:50.109506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:50.111735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 556/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:49 2022] GET /identity/v3/users/a6803dae92aa4f349f825efdb24da212 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:50.117733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:50.143593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:50.215013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237609f-9a59-44a3-8742-814e1a30ca00 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:50.248256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461be17a-510b-418d-870f-43f331fc3b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:50.248867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be17a-510b-418d-870f-43f331fc3b95 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:50.249143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be17a-510b-418d-870f-43f331fc3b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:50.249409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461be17a-510b-418d-870f-43f331fc3b95 None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:50.250769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be17a-510b-418d-870f-43f331fc3b95 None admin] RBAC: Authorizing `identity:get_project(project_id=77e510d7e98d4bb499d5a9b207d57e0b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:50.252457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461be17a-510b-418d-870f-43f331fc3b95 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:50.254040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 566/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:16:50 2022] GET /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:50.260300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:50.355075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:50.364812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061da6b-4d8a-4ac5-ab39-cd89f6eeda3d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:50.398680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be205b-7ce3-46d1-8ea8-38e196707a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:50.399330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be205b-7ce3-46d1-8ea8-38e196707a2a None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:50.399610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be205b-7ce3-46d1-8ea8-38e196707a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:50.399884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be205b-7ce3-46d1-8ea8-38e196707a2a None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b/users/a6803dae92aa4f349f825efdb24da212/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:50.401990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be205b-7ce3-46d1-8ea8-38e196707a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=77e510d7e98d4bb499d5a9b207d57e0b, user_id=a6803dae92aa4f349f825efdb24da212, role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:50.403438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be205b-7ce3-46d1-8ea8-38e196707a2a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:50.416081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 557/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:16:50 2022] PUT /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b/users/a6803dae92aa4f349f825efdb24da212/roles/e508ed31828645df8c584b7fbe1798e4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:16:52.591142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572df8d1-8a02-4950-80e2-7e6974d90a61 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:52.591661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572df8d1-8a02-4950-80e2-7e6974d90a61 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:52.591661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572df8d1-8a02-4950-80e2-7e6974d90a61 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:52.593013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 567/1124] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:52.598410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb088-617f-4f69-a6cc-6393ea8a4aaf None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:52.598842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb088-617f-4f69-a6cc-6393ea8a4aaf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:52.598950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb088-617f-4f69-a6cc-6393ea8a4aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:52.617116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5a9fb088-617f-4f69-a6cc-6393ea8a4aaf None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:52.618319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5a9fb088-617f-4f69-a6cc-6393ea8a4aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:52.684412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 558/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:52.949099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572df8d1-8a02-4950-80e2-7e6974d90a61 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:53.037634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:53.047294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572df8d1-8a02-4950-80e2-7e6974d90a61 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:53.081996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:53.082647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:53.082929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:53.083203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] PATH_INFO: `/v3/roles/e508ed31828645df8c584b7fbe1798e4` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:53.084576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] RBAC: Authorizing `identity:get_role(role_id=e508ed31828645df8c584b7fbe1798e4)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:53.085943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:53.087302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 568/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:52 2022] GET /identity/v3/roles/e508ed31828645df8c584b7fbe1798e4 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:53.093061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb088-617f-4f69-a6cc-6393ea8a4aaf None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:53.170742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:53.190430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb088-617f-4f69-a6cc-6393ea8a4aaf None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:53.223055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:53.223609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:53.223886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:53.224154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] PATH_INFO: `/v3/users/a6803dae92aa4f349f825efdb24da212` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:53.225243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] RBAC: Authorizing `identity:get_user(user_id=a6803dae92aa4f349f825efdb24da212)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:53.226697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:53.228235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 559/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:16:53 2022] GET /identity/v3/users/a6803dae92aa4f349f825efdb24da212 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:53.234199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:53.330280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d30bc-e0db-4aae-89e1-3a4027c0edba None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:53.362748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:53.363332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:53.363607 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:53.363875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:53.390874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:53.430159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:53.431577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:53.526569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 569/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:16:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:16:53.532486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:53.628913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72c78-88ca-42ef-b34b-04ca6b3c054a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:53.662280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08e34e-ed34-47cb-bb17-fa5f17be1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:53.662904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e34e-ed34-47cb-bb17-fa5f17be1e8d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:53.663185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e34e-ed34-47cb-bb17-fa5f17be1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:53.663461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e34e-ed34-47cb-bb17-fa5f17be1e8d None admin] PATH_INFO: `/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:53.664564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08e34e-ed34-47cb-bb17-fa5f17be1e8d None admin] RBAC: Authorizing `identity:get_project(project_id=77e510d7e98d4bb499d5a9b207d57e0b)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:53.665998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08e34e-ed34-47cb-bb17-fa5f17be1e8d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:53.667635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 560/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:16:53 2022] GET /identity/v3/projects/77e510d7e98d4bb499d5a9b207d57e0b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:53.674357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:53.733543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:53.774140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34298b3c-1ccb-44d1-bce1-6fcf26d75dd6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:53.807994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b9f45-210a-45bc-be84-5076b381f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:53.808588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b9f45-210a-45bc-be84-5076b381f7ee None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:53.808869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b9f45-210a-45bc-be84-5076b381f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:53.809146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b9f45-210a-45bc-be84-5076b381f7ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:53.809862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b9f45-210a-45bc-be84-5076b381f7ee None admin] RBAC: Adding query filter params (role.id=e508ed31828645df8c584b7fbe1798e4, scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b, user.id=a6803dae92aa4f349f825efdb24da212) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:16:53.810205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b9f45-210a-45bc-be84-5076b381f7ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:53.811620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b9f45-210a-45bc-be84-5076b381f7ee None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:53.817526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 570/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:16:53 2022] GET /identity/v3/role_assignments?user.id=a6803dae92aa4f349f825efdb24da212&scope.project.id=77e510d7e98d4bb499d5a9b207d57e0b&role.id=e508ed31828645df8c584b7fbe1798e4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:55.982742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9956-b09f-411d-bfde-71994336d94a None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:55.983274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9956-b09f-411d-bfde-71994336d94a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:55.983274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba9956-b09f-411d-bfde-71994336d94a None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:55.984590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 561/1131] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:55.990495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55679a-bd60-44a2-ad0e-71280256bb3c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:55.990894 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55679a-bd60-44a2-ad0e-71280256bb3c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:55.991033 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55679a-bd60-44a2-ad0e-71280256bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:56.009131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ba55679a-bd60-44a2-ad0e-71280256bb3c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:56.010328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ba55679a-bd60-44a2-ad0e-71280256bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:56.075618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 571/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:56.344120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba9956-b09f-411d-bfde-71994336d94a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:56.362468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:56.443209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba9956-b09f-411d-bfde-71994336d94a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:56.475887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cd44d-560f-40a7-890e-8aa3bfdded52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:56.476502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd44d-560f-40a7-890e-8aa3bfdded52 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:56.476783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd44d-560f-40a7-890e-8aa3bfdded52 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:56.477057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd44d-560f-40a7-890e-8aa3bfdded52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:56.478181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cd44d-560f-40a7-890e-8aa3bfdded52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:56.479615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cd44d-560f-40a7-890e-8aa3bfdded52 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:56.481150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 562/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:56.487482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55679a-bd60-44a2-ad0e-71280256bb3c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:56.540768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:56.584115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55679a-bd60-44a2-ad0e-71280256bb3c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:56.617429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0dcde-3ea5-414a-aebd-2e73c5d20065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:56.617962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dcde-3ea5-414a-aebd-2e73c5d20065 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:56.618265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dcde-3ea5-414a-aebd-2e73c5d20065 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:56.618536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dcde-3ea5-414a-aebd-2e73c5d20065 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:56.619174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0dcde-3ea5-414a-aebd-2e73c5d20065 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:56.620587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0dcde-3ea5-414a-aebd-2e73c5d20065 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:56.647977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 572/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:16:56 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:16:58.869349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db4f8-bc89-4873-9a29-f52fc4f845a3 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:58.869912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db4f8-bc89-4873-9a29-f52fc4f845a3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:58.869912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db4f8-bc89-4873-9a29-f52fc4f845a3 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:58.871256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 563/1135] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:16:58.877358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e60fd-9508-41f2-a660-d25b216932e7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:58.877758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e60fd-9508-41f2-a660-d25b216932e7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:58.877893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e60fd-9508-41f2-a660-d25b216932e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:58.896279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-aa4e60fd-9508-41f2-a660-d25b216932e7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:16:58.897449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-aa4e60fd-9508-41f2-a660-d25b216932e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:16:58.963498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 573/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:16:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:16:59.232793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31db4f8-bc89-4873-9a29-f52fc4f845a3 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:59.317169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:59.333814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31db4f8-bc89-4873-9a29-f52fc4f845a3 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:59.366558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1030ab7-fbba-4bb6-9afa-417fea5f45e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:59.367173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030ab7-fbba-4bb6-9afa-417fea5f45e5 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:59.367450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030ab7-fbba-4bb6-9afa-417fea5f45e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:59.367718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1030ab7-fbba-4bb6-9afa-417fea5f45e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:59.368799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1030ab7-fbba-4bb6-9afa-417fea5f45e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:59.370256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1030ab7-fbba-4bb6-9afa-417fea5f45e5 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:59.371792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 564/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:16:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:16:59.378684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e60fd-9508-41f2-a660-d25b216932e7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:16:59.411825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:16:59.475729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e60fd-9508-41f2-a660-d25b216932e7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:16:59.509779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516173b-0886-4f7d-9a7a-564c258ba2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:16:59.510342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516173b-0886-4f7d-9a7a-564c258ba2f6 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:16:59.510621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516173b-0886-4f7d-9a7a-564c258ba2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:16:59.510890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516173b-0886-4f7d-9a7a-564c258ba2f6 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:16:59.511540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516173b-0886-4f7d-9a7a-564c258ba2f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:16:59.512947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516173b-0886-4f7d-9a7a-564c258ba2f6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:16:59.533347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 574/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:16:59 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:17:01.687125 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd552-5de0-44ae-81f1-3cdccca6e1f4 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:01.687720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd552-5de0-44ae-81f1-3cdccca6e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:01.687720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecd552-5de0-44ae-81f1-3cdccca6e1f4 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:01.689641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 565/1139] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:01.695102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2adf1c-bb05-41a4-8c64-da12cc153a15 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:01.695488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2adf1c-bb05-41a4-8c64-da12cc153a15 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:01.695645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2adf1c-bb05-41a4-8c64-da12cc153a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:01.713362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-de2adf1c-bb05-41a4-8c64-da12cc153a15 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:01.714566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-de2adf1c-bb05-41a4-8c64-da12cc153a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:01.779182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 575/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:02.059754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecd552-5de0-44ae-81f1-3cdccca6e1f4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:02.161807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecd552-5de0-44ae-81f1-3cdccca6e1f4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:02.196531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:02.197147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:02.197424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:02.197695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:02.208565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:17:02.213301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:17:02.214451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:17:02.215702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 566/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:17:02.220828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2adf1c-bb05-41a4-8c64-da12cc153a15 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:02.244172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:02.319045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2adf1c-bb05-41a4-8c64-da12cc153a15 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:02.351278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:02.351863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:02.352136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:02.352401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:02.353045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:02.353342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:02.354713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:02.362945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 576/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:17:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:02.368719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:02.384892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:02.470329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd06cf-69f5-4aa1-baaa-61511222fafc None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:02.503309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:02.503919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:02.504194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:02.504463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] PATH_INFO: `/v3/users/f7709f5f50cd401bb320dd4202cea38e` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:02.517883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] RBAC: Authorizing `identity:get_user(user_id=f7709f5f50cd401bb320dd4202cea38e)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:02.519352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:02.520916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 567/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:17:02 2022] GET /identity/v3/users/f7709f5f50cd401bb320dd4202cea38e => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:02.526760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:02.607855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:02.623465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0da40-1d26-47b4-a73f-3936e3a0fe9d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:02.656085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:02.657371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:02.657652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:02.657924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:02.722980 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:02.724396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:02.803555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:02.820784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 577/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:17:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:17:02.826644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:02.894017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:02.924504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a3096-242e-46bf-8cf1-7093b3e18a8d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:02.958295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff50142-4b60-4ce5-bc78-e8baa5e26b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:02.958925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50142-4b60-4ce5-bc78-e8baa5e26b2c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:02.959190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50142-4b60-4ce5-bc78-e8baa5e26b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:02.959460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff50142-4b60-4ce5-bc78-e8baa5e26b2c None admin] PATH_INFO: `/v3/projects/dec6110d60754fc08adab67ab2815fab` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:02.960553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff50142-4b60-4ce5-bc78-e8baa5e26b2c None admin] RBAC: Authorizing `identity:get_project(project_id=dec6110d60754fc08adab67ab2815fab)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:02.961979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff50142-4b60-4ce5-bc78-e8baa5e26b2c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:02.963601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 568/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:17:02 2022] GET /identity/v3/projects/dec6110d60754fc08adab67ab2815fab => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:02.969592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:03.066540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f768-3e4c-4b1f-99d4-2f6732998a8d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:03.098883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd752e4f-f572-41fd-a3d3-c80393a6ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:03.099471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd752e4f-f572-41fd-a3d3-c80393a6ad67 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:03.099745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd752e4f-f572-41fd-a3d3-c80393a6ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:03.100011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd752e4f-f572-41fd-a3d3-c80393a6ad67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:03.100722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd752e4f-f572-41fd-a3d3-c80393a6ad67 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=dec6110d60754fc08adab67ab2815fab, user.id=f7709f5f50cd401bb320dd4202cea38e) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:03.101023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd752e4f-f572-41fd-a3d3-c80393a6ad67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:03.102449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd752e4f-f572-41fd-a3d3-c80393a6ad67 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:03.107581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 578/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:17:02 2022] GET /identity/v3/role_assignments?user.id=f7709f5f50cd401bb320dd4202cea38e&scope.project.id=dec6110d60754fc08adab67ab2815fab&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:05.211816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b064965-ed1d-4f8b-933a-2047bf88b539 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:05.212365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b064965-ed1d-4f8b-933a-2047bf88b539 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:05.212365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b064965-ed1d-4f8b-933a-2047bf88b539 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:05.213684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 569/1147] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:05.218784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465cb8f-f01b-45e4-85a5-58ec3641b2ed None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:05.219182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465cb8f-f01b-45e4-85a5-58ec3641b2ed None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:05.219328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465cb8f-f01b-45e4-85a5-58ec3641b2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:05.237475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3465cb8f-f01b-45e4-85a5-58ec3641b2ed None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:05.238664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3465cb8f-f01b-45e4-85a5-58ec3641b2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:05.280747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:05.303969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 579/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:05.572402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b064965-ed1d-4f8b-933a-2047bf88b539 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:05.671446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b064965-ed1d-4f8b-933a-2047bf88b539 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:05.706542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:05.707194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:05.707468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:05.707738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:05.714613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:05.719359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:17:05.724746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:17:05.725870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:17:05.726978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 570/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:17:05.731952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465cb8f-f01b-45e4-85a5-58ec3641b2ed None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:05.827103 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465cb8f-f01b-45e4-85a5-58ec3641b2ed None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:05.860387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:05.860977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:05.861252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:05.861523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:05.862207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:05.862510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:05.863863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:05.871661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 580/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:17:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:05.878187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:05.983461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ca109-1ba2-4db5-b9ba-ab837e7a854c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:06.017642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:06.018349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:06.018627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:06.018894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] PATH_INFO: `/v3/users/f7709f5f50cd401bb320dd4202cea38e` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:06.019994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] RBAC: Authorizing `identity:get_user(user_id=f7709f5f50cd401bb320dd4202cea38e)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:06.021411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:06.022991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 571/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:17:05 2022] GET /identity/v3/users/f7709f5f50cd401bb320dd4202cea38e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:06.028808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:06.070224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:06.128292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63181c15-677d-4c1e-ae58-b0298e5bc256 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:06.161238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cdec8-6c90-46b5-9f82-cf9f67cabde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:06.161857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cdec8-6c90-46b5-9f82-cf9f67cabde0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:06.162163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cdec8-6c90-46b5-9f82-cf9f67cabde0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:06.162434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cdec8-6c90-46b5-9f82-cf9f67cabde0 None admin] PATH_INFO: `/v3/projects/dec6110d60754fc08adab67ab2815fab` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:06.163509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cdec8-6c90-46b5-9f82-cf9f67cabde0 None admin] RBAC: Authorizing `identity:get_project(project_id=dec6110d60754fc08adab67ab2815fab)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:06.164915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cdec8-6c90-46b5-9f82-cf9f67cabde0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:06.166564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 581/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:17:06 2022] GET /identity/v3/projects/dec6110d60754fc08adab67ab2815fab => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:06.173071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:06.236349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:06.270015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b54828-b03d-4b42-88f7-64fa6631f85a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:06.302634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4deaa30-1aa1-417f-985c-0dfba80f2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:06.303275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaa30-1aa1-417f-985c-0dfba80f2b60 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:06.303551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaa30-1aa1-417f-985c-0dfba80f2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:06.303819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaa30-1aa1-417f-985c-0dfba80f2b60 None admin] PATH_INFO: `/v3/projects/dec6110d60754fc08adab67ab2815fab/users/f7709f5f50cd401bb320dd4202cea38e/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:06.305653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deaa30-1aa1-417f-985c-0dfba80f2b60 None admin] RBAC: Authorizing `identity:create_grant(project_id=dec6110d60754fc08adab67ab2815fab, user_id=f7709f5f50cd401bb320dd4202cea38e, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:06.307105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deaa30-1aa1-417f-985c-0dfba80f2b60 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:06.320928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 572/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:17:06 2022] PUT /identity/v3/projects/dec6110d60754fc08adab67ab2815fab/users/f7709f5f50cd401bb320dd4202cea38e/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:17:08.466994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e680-88dc-4387-a8cb-6d3a3a781f3d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:08.467551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e680-88dc-4387-a8cb-6d3a3a781f3d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:08.467551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e680-88dc-4387-a8cb-6d3a3a781f3d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:08.469757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 582/1154] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:08.475186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a7878-6b3f-4bee-8039-879578082f96 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:08.475590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a7878-6b3f-4bee-8039-879578082f96 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:08.475732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a7878-6b3f-4bee-8039-879578082f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:08.493881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1a8a7878-6b3f-4bee-8039-879578082f96 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:08.495074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1a8a7878-6b3f-4bee-8039-879578082f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:08.559145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 573/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:08.829541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e680-88dc-4387-a8cb-6d3a3a781f3d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:08.932464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e680-88dc-4387-a8cb-6d3a3a781f3d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:08.942068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:08.968000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:08.968945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:08.969242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:08.969516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:08.979841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:17:08.985473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:17:08.990161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:17:08.991341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 583/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:17:08.992783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a7878-6b3f-4bee-8039-879578082f96 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:09.047109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:09.096230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a7878-6b3f-4bee-8039-879578082f96 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:09.129865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:09.130489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:09.130770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:09.131046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:09.131708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:09.132009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:09.133433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:09.141315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 574/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:09.147253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:09.243977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63699ed6-e7a3-42f2-99ce-0247bb79264d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:09.276715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:09.277334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:09.277615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:09.277886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] PATH_INFO: `/v3/users/f7709f5f50cd401bb320dd4202cea38e` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:09.279015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] RBAC: Authorizing `identity:get_user(user_id=f7709f5f50cd401bb320dd4202cea38e)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:09.280428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:09.282024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 584/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:17:09 2022] GET /identity/v3/users/f7709f5f50cd401bb320dd4202cea38e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:09.287734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:09.384728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe581b-9386-4c6a-9ef2-2bd7bd00c6eb None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:09.400742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:09.417677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:09.418306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:09.418588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:09.418861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:09.483248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:09.484741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:09.579213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 575/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:17:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:17:09.585093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:09.619736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:09.684399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d3e9e-fcb7-40dd-afc4-655ed15c5889 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:09.716162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cd656-9dad-48ab-8983-85402b7508e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:09.716777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd656-9dad-48ab-8983-85402b7508e1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:09.717053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd656-9dad-48ab-8983-85402b7508e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:09.717319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cd656-9dad-48ab-8983-85402b7508e1 None admin] PATH_INFO: `/v3/projects/dec6110d60754fc08adab67ab2815fab` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:09.719099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cd656-9dad-48ab-8983-85402b7508e1 None admin] RBAC: Authorizing `identity:get_project(project_id=dec6110d60754fc08adab67ab2815fab)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:09.720515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cd656-9dad-48ab-8983-85402b7508e1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:09.722133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 585/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:17:09 2022] GET /identity/v3/projects/dec6110d60754fc08adab67ab2815fab => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:09.728342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:09.746335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:09.825225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872f2e7-b322-474b-879c-41927ca5910a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:09.859046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817cf6b-6d0a-4533-9690-cce2d8e8fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:09.859785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817cf6b-6d0a-4533-9690-cce2d8e8fca8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:09.860065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817cf6b-6d0a-4533-9690-cce2d8e8fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:09.860335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817cf6b-6d0a-4533-9690-cce2d8e8fca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:09.861046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817cf6b-6d0a-4533-9690-cce2d8e8fca8 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=dec6110d60754fc08adab67ab2815fab, user.id=f7709f5f50cd401bb320dd4202cea38e) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:09.861350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817cf6b-6d0a-4533-9690-cce2d8e8fca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:09.862800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817cf6b-6d0a-4533-9690-cce2d8e8fca8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:09.868329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 576/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:17:09 2022] GET /identity/v3/role_assignments?user.id=f7709f5f50cd401bb320dd4202cea38e&scope.project.id=dec6110d60754fc08adab67ab2815fab&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:12.087356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af555ce-4b9d-481b-8186-64959db4ba77 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:12.087847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af555ce-4b9d-481b-8186-64959db4ba77 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:12.087938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af555ce-4b9d-481b-8186-64959db4ba77 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:12.089246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 586/1162] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:12.094699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc917f8-24fb-46a2-9f2a-d5c18d730d48 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:12.095111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc917f8-24fb-46a2-9f2a-d5c18d730d48 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:12.095228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc917f8-24fb-46a2-9f2a-d5c18d730d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:12.113454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-bfc917f8-24fb-46a2-9f2a-d5c18d730d48 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:12.114652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bfc917f8-24fb-46a2-9f2a-d5c18d730d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:12.180751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 577/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:12.448530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af555ce-4b9d-481b-8186-64959db4ba77 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:12.546389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af555ce-4b9d-481b-8186-64959db4ba77 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:12.548725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:12.580217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:12.580810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:12.581083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:12.581347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:12.644817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:12.646253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:12.740298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 587/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:17:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:17:12.746151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc917f8-24fb-46a2-9f2a-d5c18d730d48 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:12.760098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:12.844466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc917f8-24fb-46a2-9f2a-d5c18d730d48 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:12.877644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72385a0d-1a9a-4919-96e7-e5400cd46edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:12.878285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385a0d-1a9a-4919-96e7-e5400cd46edb None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:12.878570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385a0d-1a9a-4919-96e7-e5400cd46edb None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:12.878842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72385a0d-1a9a-4919-96e7-e5400cd46edb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:12.885218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72385a0d-1a9a-4919-96e7-e5400cd46edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:12.886680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72385a0d-1a9a-4919-96e7-e5400cd46edb None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-72385a0d-1a9a-4919-96e7-e5400cd46edb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:17:12.898530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:17:12.899780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:17:12.900887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 578/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:17:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:17:12.905527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:12.908644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:13.004324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5a5cc-7bad-423e-aaba-938e4c7e856c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:13.036960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f45bb-d6e5-4399-8a02-d2efd7c8d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:13.037557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f45bb-d6e5-4399-8a02-d2efd7c8d785 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:13.037832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f45bb-d6e5-4399-8a02-d2efd7c8d785 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:13.038126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f45bb-d6e5-4399-8a02-d2efd7c8d785 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:13.038758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f45bb-d6e5-4399-8a02-d2efd7c8d785 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:13.039059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f45bb-d6e5-4399-8a02-d2efd7c8d785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:13.040404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f45bb-d6e5-4399-8a02-d2efd7c8d785 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:13.048092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 588/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Fri Sep 30 19:17:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:15.193461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2358-42ff-4e99-b8f0-481b130a362f None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:15.194003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2358-42ff-4e99-b8f0-481b130a362f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:15.194003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac2358-42ff-4e99-b8f0-481b130a362f None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:15.195351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 579/1167] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:15.200624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b66f-7194-45f0-b2c8-78aaa11842fd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:15.201008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b66f-7194-45f0-b2c8-78aaa11842fd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:15.201160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0b66f-7194-45f0-b2c8-78aaa11842fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:15.220217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-61e0b66f-7194-45f0-b2c8-78aaa11842fd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:15.221373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-61e0b66f-7194-45f0-b2c8-78aaa11842fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:15.279970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:15.285922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 589/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:15.551055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2358-42ff-4e99-b8f0-481b130a362f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:15.619561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:15.648280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac2358-42ff-4e99-b8f0-481b130a362f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:15.681041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300628f-1ff0-4903-9f3a-43f6026a36f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:15.681626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300628f-1ff0-4903-9f3a-43f6026a36f3 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:15.681900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300628f-1ff0-4903-9f3a-43f6026a36f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:15.682199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300628f-1ff0-4903-9f3a-43f6026a36f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:15.682853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300628f-1ff0-4903-9f3a-43f6026a36f3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:15.684194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300628f-1ff0-4903-9f3a-43f6026a36f3 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:15.699433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 580/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Fri Sep 30 19:17:15 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:17:17.837764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fc7e0-a0f1-48b2-99d3-81de64442f18 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:17.838351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fc7e0-a0f1-48b2-99d3-81de64442f18 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:17.838351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fc7e0-a0f1-48b2-99d3-81de64442f18 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:17.839717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 590/1170] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:17.845528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398be24-1cac-4b36-a457-1848ed10be32 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:17.845966 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398be24-1cac-4b36-a457-1848ed10be32 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:17.846097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398be24-1cac-4b36-a457-1848ed10be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:17.864522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1398be24-1cac-4b36-a457-1848ed10be32 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:17.865708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1398be24-1cac-4b36-a457-1848ed10be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:17.932993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 581/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:18.202488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fc7e0-a0f1-48b2-99d3-81de64442f18 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:18.302957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fc7e0-a0f1-48b2-99d3-81de64442f18 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:18.335185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2bc27-3b5d-4ccc-a295-b6630be3bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:18.335805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2bc27-3b5d-4ccc-a295-b6630be3bfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:18.336084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2bc27-3b5d-4ccc-a295-b6630be3bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:18.336356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2bc27-3b5d-4ccc-a295-b6630be3bfe7 None admin] PATH_INFO: `/v3/domains/d3fef0612ed8485f9b8a82d65fbb28e6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:18.346980 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2bc27-3b5d-4ccc-a295-b6630be3bfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d3fef0612ed8485f9b8a82d65fbb28e6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:18.348403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2bc27-3b5d-4ccc-a295-b6630be3bfe7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:18.349953 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 591/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Fri Sep 30 19:17:18 2022] GET /identity/v3/domains/d3fef0612ed8485f9b8a82d65fbb28e6 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:18.355774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398be24-1cac-4b36-a457-1848ed10be32 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:18.415219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:18.453832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398be24-1cac-4b36-a457-1848ed10be32 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:18.487200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b03d76-5bdf-4671-929a-a9aecf66a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:18.487803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b03d76-5bdf-4671-929a-a9aecf66a430 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:18.488082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b03d76-5bdf-4671-929a-a9aecf66a430 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:18.488355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b03d76-5bdf-4671-929a-a9aecf66a430 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:18.489000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b03d76-5bdf-4671-929a-a9aecf66a430 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:18.490465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b03d76-5bdf-4671-929a-a9aecf66a430 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:18.515953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 582/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:17:18 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:17:20.699815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca23d6d-2d24-4e3b-9b65-a2b38f0b33ed None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:20.700378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca23d6d-2d24-4e3b-9b65-a2b38f0b33ed None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:20.700378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca23d6d-2d24-4e3b-9b65-a2b38f0b33ed None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:20.702313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 592/1174] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:20.707674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816f5d-afd4-49c0-9ee8-2bca1abb3d6c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:20.708095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816f5d-afd4-49c0-9ee8-2bca1abb3d6c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:20.708219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75816f5d-afd4-49c0-9ee8-2bca1abb3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:20.726133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-75816f5d-afd4-49c0-9ee8-2bca1abb3d6c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:20.727305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-75816f5d-afd4-49c0-9ee8-2bca1abb3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:20.793353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 583/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:21.063015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca23d6d-2d24-4e3b-9b65-a2b38f0b33ed None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:21.126476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:21.168237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca23d6d-2d24-4e3b-9b65-a2b38f0b33ed None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:21.201336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776948a-efc9-489c-8e70-cdfd830228cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:21.202021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776948a-efc9-489c-8e70-cdfd830228cf None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:21.202326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776948a-efc9-489c-8e70-cdfd830228cf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:21.202595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776948a-efc9-489c-8e70-cdfd830228cf None admin] PATH_INFO: `/v3/domains/d3fef0612ed8485f9b8a82d65fbb28e6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:21.203685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776948a-efc9-489c-8e70-cdfd830228cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=d3fef0612ed8485f9b8a82d65fbb28e6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:21.205097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776948a-efc9-489c-8e70-cdfd830228cf None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:21.206677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 593/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Fri Sep 30 19:17:21 2022] GET /identity/v3/domains/d3fef0612ed8485f9b8a82d65fbb28e6 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:17:21.212452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75816f5d-afd4-49c0-9ee8-2bca1abb3d6c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:21.257247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:21.310678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75816f5d-afd4-49c0-9ee8-2bca1abb3d6c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:21.344351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca844aa-a25e-4952-b17b-2f5fdb344b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:21.344940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca844aa-a25e-4952-b17b-2f5fdb344b21 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:21.345216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca844aa-a25e-4952-b17b-2f5fdb344b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:21.345484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca844aa-a25e-4952-b17b-2f5fdb344b21 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:21.346154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca844aa-a25e-4952-b17b-2f5fdb344b21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:21.347598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca844aa-a25e-4952-b17b-2f5fdb344b21 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:21.368394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 584/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:17:21 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:17:23.541727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072efdda-2cd1-4dd5-aaee-2bdae7171529 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:23.542277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072efdda-2cd1-4dd5-aaee-2bdae7171529 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:23.542277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072efdda-2cd1-4dd5-aaee-2bdae7171529 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:23.543565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 594/1178] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:23.549903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1f7f-296a-4823-8e9f-cf4336247bb5 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:23.550323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1f7f-296a-4823-8e9f-cf4336247bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:23.550480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc1f7f-296a-4823-8e9f-cf4336247bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:23.568783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4edc1f7f-296a-4823-8e9f-cf4336247bb5 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:23.569956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4edc1f7f-296a-4823-8e9f-cf4336247bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:23.634694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 585/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:23.901159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072efdda-2cd1-4dd5-aaee-2bdae7171529 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:24.004811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072efdda-2cd1-4dd5-aaee-2bdae7171529 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:24.030982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:24.040829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:24.041463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:24.041740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:24.042013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:24.059765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:17:24.064867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:17:24.066008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:17:24.067231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 595/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:17:24.072026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1f7f-296a-4823-8e9f-cf4336247bb5 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:24.103287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:24.178258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc1f7f-296a-4823-8e9f-cf4336247bb5 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:24.213030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:24.213634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:24.213907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:24.214211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:24.214871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:24.215170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:24.216520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:24.224837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 586/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:24.230929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:24.331955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71406a-8f76-4a5e-a04b-73e57c3f9c84 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:24.365486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:24.366126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:24.366406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:24.366676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] PATH_INFO: `/v3/users/37c4c9fca05c4e3ebcb1e8450bb77f96` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:24.379917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] RBAC: Authorizing `identity:get_user(user_id=37c4c9fca05c4e3ebcb1e8450bb77f96)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:24.381340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:24.382947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 596/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:17:24 2022] GET /identity/v3/users/37c4c9fca05c4e3ebcb1e8450bb77f96 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:24.389213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:24.479390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:24.488850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c670801-8726-4d80-ad61-0d62868fb392 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:24.522913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:24.523508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:24.523785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:24.524057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:24.592599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:24.594037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:24.681332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:24.691693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 587/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:17:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:17:24.697611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:24.742632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:24.796664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9b1d2-2c08-47a6-8e60-979869b35008 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:24.829388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9813a-fcdb-46fe-b4ff-e50e0715a472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:24.830010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9813a-fcdb-46fe-b4ff-e50e0715a472 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:24.830319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9813a-fcdb-46fe-b4ff-e50e0715a472 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:24.830590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9813a-fcdb-46fe-b4ff-e50e0715a472 None admin] PATH_INFO: `/v3/projects/e642af0e154043478de4f2cd90c7844d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:24.831692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9813a-fcdb-46fe-b4ff-e50e0715a472 None admin] RBAC: Authorizing `identity:get_project(project_id=e642af0e154043478de4f2cd90c7844d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:24.833104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9813a-fcdb-46fe-b4ff-e50e0715a472 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:24.834754 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 597/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:17:24 2022] GET /identity/v3/projects/e642af0e154043478de4f2cd90c7844d => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:24.840744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:24.936194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bef54-1a0e-4478-9932-a16d127ad66a None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:24.968680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6bfa9-66ef-4ada-bedf-44d126119454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:24.969261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6bfa9-66ef-4ada-bedf-44d126119454 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:24.969541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6bfa9-66ef-4ada-bedf-44d126119454 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:24.969804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6bfa9-66ef-4ada-bedf-44d126119454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:24.970533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6bfa9-66ef-4ada-bedf-44d126119454 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=e642af0e154043478de4f2cd90c7844d, user.id=37c4c9fca05c4e3ebcb1e8450bb77f96) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:24.970841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6bfa9-66ef-4ada-bedf-44d126119454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:24.972249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6bfa9-66ef-4ada-bedf-44d126119454 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:24.977336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 588/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:17:24 2022] GET /identity/v3/role_assignments?user.id=37c4c9fca05c4e3ebcb1e8450bb77f96&scope.project.id=e642af0e154043478de4f2cd90c7844d&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:27.064655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffc3fe-d43c-4bc3-b047-0bee0ffa3d0e None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:27.065070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffc3fe-d43c-4bc3-b047-0bee0ffa3d0e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:27.065199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffc3fe-d43c-4bc3-b047-0bee0ffa3d0e None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:27.066571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 598/1186] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:27.071582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50597-cb41-473d-ac38-43595ee088ea None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:27.071966 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50597-cb41-473d-ac38-43595ee088ea None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:27.072130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c50597-cb41-473d-ac38-43595ee088ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:27.089770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-52c50597-cb41-473d-ac38-43595ee088ea None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:27.090976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-52c50597-cb41-473d-ac38-43595ee088ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:27.139855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:27.156552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 589/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:27.421717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffc3fe-d43c-4bc3-b047-0bee0ffa3d0e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:27.519425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffc3fe-d43c-4bc3-b047-0bee0ffa3d0e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:27.532530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:27.553494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:27.554131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:27.554410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:27.554677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:27.564478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:17:27.569180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:17:27.570338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:17:27.571398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 599/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:17:27.576446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50597-cb41-473d-ac38-43595ee088ea None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:27.673486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c50597-cb41-473d-ac38-43595ee088ea None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:27.706489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:27.707075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:27.707351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:27.707621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:27.708269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:27.708568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:27.709926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:27.717958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 590/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:27.724310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:27.821556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045bee6-0922-4e7d-8e15-02b1fcc7de25 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:27.853437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:27.854081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:27.854360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:27.854632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] PATH_INFO: `/v3/users/37c4c9fca05c4e3ebcb1e8450bb77f96` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:27.855724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] RBAC: Authorizing `identity:get_user(user_id=37c4c9fca05c4e3ebcb1e8450bb77f96)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:27.857620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:27.859209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 600/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:17:27 2022] GET /identity/v3/users/37c4c9fca05c4e3ebcb1e8450bb77f96 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:27.864782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:27.911970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:27.961291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258bdf8-1af9-4efe-9fa5-a50e95b62da7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:27.993746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1d9bf-51df-47ae-b2d3-5baaf6b8a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:27.994386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d9bf-51df-47ae-b2d3-5baaf6b8a43a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:27.994662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d9bf-51df-47ae-b2d3-5baaf6b8a43a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:27.994928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d9bf-51df-47ae-b2d3-5baaf6b8a43a None admin] PATH_INFO: `/v3/projects/e642af0e154043478de4f2cd90c7844d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:27.996015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1d9bf-51df-47ae-b2d3-5baaf6b8a43a None admin] RBAC: Authorizing `identity:get_project(project_id=e642af0e154043478de4f2cd90c7844d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:27.997431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1d9bf-51df-47ae-b2d3-5baaf6b8a43a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:27.999427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 591/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:17:27 2022] GET /identity/v3/projects/e642af0e154043478de4f2cd90c7844d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:28.005600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:28.047587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:28.104029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb75dd-74bd-420d-a4e3-0dc252ec0a1e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:28.136602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bddd77-84c4-4fd8-b027-3465a0bd428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:28.137238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bddd77-84c4-4fd8-b027-3465a0bd428d None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:28.137514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bddd77-84c4-4fd8-b027-3465a0bd428d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:28.137782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bddd77-84c4-4fd8-b027-3465a0bd428d None admin] PATH_INFO: `/v3/projects/e642af0e154043478de4f2cd90c7844d/users/37c4c9fca05c4e3ebcb1e8450bb77f96/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:28.140376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bddd77-84c4-4fd8-b027-3465a0bd428d None admin] RBAC: Authorizing `identity:create_grant(project_id=e642af0e154043478de4f2cd90c7844d, user_id=37c4c9fca05c4e3ebcb1e8450bb77f96, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:28.141779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bddd77-84c4-4fd8-b027-3465a0bd428d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:28.154798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 601/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:17:28 2022] PUT /identity/v3/projects/e642af0e154043478de4f2cd90c7844d/users/37c4c9fca05c4e3ebcb1e8450bb77f96/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:17:30.274042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b31b6-340d-4be6-be8a-7ead0b5c5742 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:30.274585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b31b6-340d-4be6-be8a-7ead0b5c5742 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:30.274585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b31b6-340d-4be6-be8a-7ead0b5c5742 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:30.275922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 592/1193] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:17:30.281265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10093e6-dd62-4480-906c-b30501685f6b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:30.281666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10093e6-dd62-4480-906c-b30501685f6b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:30.281819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10093e6-dd62-4480-906c-b30501685f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:30.300096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e10093e6-dd62-4480-906c-b30501685f6b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:17:30.301278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e10093e6-dd62-4480-906c-b30501685f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:17:30.366776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 602/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:17:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:17:30.635140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b31b6-340d-4be6-be8a-7ead0b5c5742 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:30.734285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b31b6-340d-4be6-be8a-7ead0b5c5742 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:30.749870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:30.767341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:30.767953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:30.768229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:30.768499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:30.778586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:17:30.783322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:17:30.784424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:17:30.785344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 593/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:17:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:17:30.790532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10093e6-dd62-4480-906c-b30501685f6b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:30.820097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:30.889458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10093e6-dd62-4480-906c-b30501685f6b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:30.922366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:30.922965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:30.923240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:30.923511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:30.924175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:30.924478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:30.925835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:30.933654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 603/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:30.940303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:31.035492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bb94c-be92-4cb7-b08d-9df7e65dc808 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:31.070846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:31.071468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:31.071744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:31.072012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] PATH_INFO: `/v3/users/37c4c9fca05c4e3ebcb1e8450bb77f96` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:31.073103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] RBAC: Authorizing `identity:get_user(user_id=37c4c9fca05c4e3ebcb1e8450bb77f96)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:31.074564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:31.076324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 594/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Fri Sep 30 19:17:30 2022] GET /identity/v3/users/37c4c9fca05c4e3ebcb1e8450bb77f96 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:31.082113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:31.172104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:31.180812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b80e4-b4bc-4acf-aae7-5fc89f119194 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:31.214722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:31.215317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:31.215594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:31.215865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:31.281328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:31.282786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:31.367951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:31.378487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 604/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:17:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:17:31.384564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:31.429278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:31.482510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16ce61-d4ec-4145-9e7c-3256a879720d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:31.514576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30c04c-efbe-4347-979a-58185c1e0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:31.515182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30c04c-efbe-4347-979a-58185c1e0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:31.515455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30c04c-efbe-4347-979a-58185c1e0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:31.515722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30c04c-efbe-4347-979a-58185c1e0cf9 None admin] PATH_INFO: `/v3/projects/e642af0e154043478de4f2cd90c7844d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:31.516805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30c04c-efbe-4347-979a-58185c1e0cf9 None admin] RBAC: Authorizing `identity:get_project(project_id=e642af0e154043478de4f2cd90c7844d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:31.518252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30c04c-efbe-4347-979a-58185c1e0cf9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:31.519819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 595/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Fri Sep 30 19:17:31 2022] GET /identity/v3/projects/e642af0e154043478de4f2cd90c7844d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:31.525918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:17:31.621071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1749c11-d13a-46b3-b7dd-83314816db29 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:17:31.653699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fe348-729e-4252-bc24-f799cd5511a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:17:31.654807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fe348-729e-4252-bc24-f799cd5511a8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:17:31.655081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fe348-729e-4252-bc24-f799cd5511a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:17:31.655351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fe348-729e-4252-bc24-f799cd5511a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:17:31.656057 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fe348-729e-4252-bc24-f799cd5511a8 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=e642af0e154043478de4f2cd90c7844d, user.id=37c4c9fca05c4e3ebcb1e8450bb77f96) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:17:31.656362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fe348-729e-4252-bc24-f799cd5511a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:17:31.657765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749fe348-729e-4252-bc24-f799cd5511a8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:17:31.663303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 605/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:17:31 2022] GET /identity/v3/role_assignments?user.id=37c4c9fca05c4e3ebcb1e8450bb77f96&scope.project.id=e642af0e154043478de4f2cd90c7844d&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:17:41.510046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=44 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:17:41.660825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=72 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:27.809728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20324-f41d-4929-bd8a-f51cb96bb6c7 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:27.810397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20324-f41d-4929-bd8a-f51cb96bb6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:27.810397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20324-f41d-4929-bd8a-f51cb96bb6c7 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:27.811876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 596/1201] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:18:27.817841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce9575-ccc8-4e56-8342-ac260b40ed3d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:27.818398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce9575-ccc8-4e56-8342-ac260b40ed3d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:27.818496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce9575-ccc8-4e56-8342-ac260b40ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:27.841438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a7ce9575-ccc8-4e56-8342-ac260b40ed3d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:18:27.841438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a7ce9575-ccc8-4e56-8342-ac260b40ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:18:27.935945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 606/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:18:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:18:28.217923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b20324-f41d-4929-bd8a-f51cb96bb6c7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:28.351349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b20324-f41d-4929-bd8a-f51cb96bb6c7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:28.391727 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:28.392807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:28.393309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:28.393863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:28.406508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:28.407981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:28.426698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:28.427844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:28.434677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:28.434677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:28.434677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:28.434677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 597/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:28.438288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce9575-ccc8-4e56-8342-ac260b40ed3d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:28.569887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce9575-ccc8-4e56-8342-ac260b40ed3d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:28.606609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:28.614074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c43e01-799c-4567-9377-65fb5eb5ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:28.615164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43e01-799c-4567-9377-65fb5eb5ab69 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:28.615713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43e01-799c-4567-9377-65fb5eb5ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:28.616328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43e01-799c-4567-9377-65fb5eb5ab69 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:28.617253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c43e01-799c-4567-9377-65fb5eb5ab69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:28.617641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c43e01-799c-4567-9377-65fb5eb5ab69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:28.619311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c43e01-799c-4567-9377-65fb5eb5ab69 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:28.640576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 607/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:28.643654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:28.722407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:28.787066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd37e8f-1d0e-4275-ab4c-16f2bae824bc None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:28.843281 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998885b-6e7f-4ad6-b283-846b152de11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:28.843959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998885b-6e7f-4ad6-b283-846b152de11e None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:28.844242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998885b-6e7f-4ad6-b283-846b152de11e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:28.844637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998885b-6e7f-4ad6-b283-846b152de11e None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:28.845295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998885b-6e7f-4ad6-b283-846b152de11e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:28.846917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998885b-6e7f-4ad6-b283-846b152de11e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:28.881782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 598/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Fri Sep 30 19:18:28 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:18:31.537702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a876e-2b44-45cc-8c80-c908ef4d577e None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:31.538366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a876e-2b44-45cc-8c80-c908ef4d577e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:31.538366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a876e-2b44-45cc-8c80-c908ef4d577e None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:31.540202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 608/1206] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:18:31.545783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53215-07ca-4359-ae10-52972fa71b28 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:31.546262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53215-07ca-4359-ae10-52972fa71b28 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:31.546533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53215-07ca-4359-ae10-52972fa71b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:31.565612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f6a53215-07ca-4359-ae10-52972fa71b28 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:18:31.566905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f6a53215-07ca-4359-ae10-52972fa71b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:18:31.645494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 599/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:18:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:18:31.933252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a876e-2b44-45cc-8c80-c908ef4d577e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:32.056818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a876e-2b44-45cc-8c80-c908ef4d577e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:32.097986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:32.098633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:32.098939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:32.099180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:32.112447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:18:32.118558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:32.119886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:18:32.120760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:32.125240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 609/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:18:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:32.126883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a53215-07ca-4359-ae10-52972fa71b28 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:32.175890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:32.245749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a53215-07ca-4359-ae10-52972fa71b28 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:32.285415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:32.286279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:32.286601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:32.286947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:32.287815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:32.288257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:32.290141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:32.304483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 600/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:18:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:18:32.306027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:32.368170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:32.436501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f29f79-2ef9-4df5-8d06-0eb9d81f24dc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:32.483038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:32.483709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:32.483994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:32.484270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:32.496096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:32.497794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:32.515719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:32.517030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:32.518380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:32.518380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:32.518380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:32.522076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 610/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:32.522945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:32.636136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:32.641193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34758c87-e334-418e-a98c-02cbabf99ce1 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:32.687450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:32.688256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:32.688709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:32.689105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:32.689880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:32.690340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:32.692121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:32.718984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 601/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:32.720288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:32.838568 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415bad-428e-4b56-b5b3-68ee89e639a6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:32.840196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:32.876674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:32.877317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:32.877579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:32.877846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:32.886348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:32.887952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:18:32.901533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:32.902734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:32.903874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:32.905742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 611/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:32.911554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:33.026585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3276b0-a796-472e-a812-7e0ef3996861 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:33.071030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:33.071637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:33.071910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:33.072174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:33.072925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:33.073235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:33.074670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:33.092960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 602/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 30 19:18:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:33.098546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:33.211871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd512cf-2c00-4af6-94d8-7fd1ed1b4e58 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:33.251359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:33.251961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:33.252291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:33.252540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:33.292081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:33.337615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:33.339071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:33.464060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 612/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:18:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:18:33.465090 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:33.489812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:33.589809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc3cfe-91ca-4047-905a-c43bc89d79f9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:33.634191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:33.634881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:33.635201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:33.635545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:33.651259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:33.652820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:33.670508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:33.671871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:33.673287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:33.673287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:33.673287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:33.674760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 603/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:33.681186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:33.767386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:33.814991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a133-cf22-4b2e-88fd-8d10424b9af6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:33.858412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:33.859895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:33.860920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:33.860920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:33.862160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:33.862392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:33.864266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:33.881050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 613/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:33.887434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:33.972541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:34.010170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0d2a2-0223-4c6d-b681-d1b928f6634f None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:34.049975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:34.050643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:34.050920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:34.051183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:34.063011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:34.064504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:18:34.077119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:34.078317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:34.079555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 604/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:34.084332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:34.189382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63e218-3b73-4b8b-801b-6c63c17f7ac0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:34.217772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:34.233574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797a178-6605-4d78-ad05-1ddcab7414b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:34.234291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797a178-6605-4d78-ad05-1ddcab7414b7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:34.234843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797a178-6605-4d78-ad05-1ddcab7414b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:34.235192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797a178-6605-4d78-ad05-1ddcab7414b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:34.236121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797a178-6605-4d78-ad05-1ddcab7414b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:34.236553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797a178-6605-4d78-ad05-1ddcab7414b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:34.238149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797a178-6605-4d78-ad05-1ddcab7414b7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:34.252416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 614/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:34.260075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:34.376061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c020f74-14ef-4af8-84c8-aaa8333b2a11 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:34.405201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:34.411934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeae09-d874-4557-a1fe-c6ad3aa0121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:34.412806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeae09-d874-4557-a1fe-c6ad3aa0121f None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:34.413124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeae09-d874-4557-a1fe-c6ad3aa0121f None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:34.413422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeae09-d874-4557-a1fe-c6ad3aa0121f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:34.414829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeae09-d874-4557-a1fe-c6ad3aa0121f None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=632070e9f5534d54852df7f6f0d50461) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:34.415254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeae09-d874-4557-a1fe-c6ad3aa0121f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:34.416785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeae09-d874-4557-a1fe-c6ad3aa0121f None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:34.423172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 605/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:18:34 2022] GET /identity/v3/role_assignments?user.id=632070e9f5534d54852df7f6f0d50461&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:36.662218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa1dd-dd2e-4e50-841e-14587d3c1c59 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:36.662756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa1dd-dd2e-4e50-841e-14587d3c1c59 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:36.662873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaa1dd-dd2e-4e50-841e-14587d3c1c59 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:36.665118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 615/1220] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:18:36.670986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed7562-45ed-4332-8fe4-700422ffa2eb None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:36.671516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed7562-45ed-4332-8fe4-700422ffa2eb None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:36.671709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed7562-45ed-4332-8fe4-700422ffa2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:36.697351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-45ed7562-45ed-4332-8fe4-700422ffa2eb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:18:36.699475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-45ed7562-45ed-4332-8fe4-700422ffa2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:18:36.792079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 606/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:18:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:18:37.065132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa1dd-dd2e-4e50-841e-14587d3c1c59 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:37.185682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaa1dd-dd2e-4e50-841e-14587d3c1c59 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:37.223961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:37.224570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:37.224841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:37.225113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:37.236516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:18:37.241423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:37.243266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:37.244438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 616/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:18:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:37.250600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed7562-45ed-4332-8fe4-700422ffa2eb None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:37.358554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed7562-45ed-4332-8fe4-700422ffa2eb None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:37.384431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:37.397585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:37.398562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:37.398941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:37.399216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:37.399879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:37.400266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:37.401921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:37.410416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 607/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:18:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:37.416460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:37.464147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:37.532041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9e77-46fb-41ee-bdb1-b1843c1a3278 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:37.565736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:37.566392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:37.566715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:37.566985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:37.578201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:37.579729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:37.595605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:37.600264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:37.601502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:37.601502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:37.601502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:37.601502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 617/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:37.602580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:37.710741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39d8e-5396-43e4-beaf-8f60f520faf7 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:37.749037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:37.749645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:37.749923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:37.750226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:37.750853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:37.751148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:37.752511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:37.765164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 608/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:37.770905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:37.877020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:37.885844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34089-e95d-4964-9012-a923245b4692 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:37.924564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:37.925193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:37.925487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:37.925739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:37.935525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:37.937376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:18:37.949731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:37.950916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:37.952115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 618/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:37.957006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:38.008613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:38.071079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4404787-9b01-4f84-a61e-1fac7d156e91 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:38.108355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:38.109133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:38.109511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:38.109931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:38.110889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:38.111260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:38.112992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:38.131884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 609/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 30 19:18:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:38.139055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:38.251361 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5b878-4344-4703-8108-e316c2fb07d5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:38.291603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:38.292399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:38.292813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:38.293091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:38.305414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:38.307216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:38.324028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:38.325213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:38.326340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:38.326340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:38.326340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:38.326340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 619/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:38.331110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:38.442961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85b90f-b3c4-458b-8aab-04615fb1bf8b None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:38.446300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:38.482793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:38.483397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:38.483668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:38.483934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:38.484573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:38.484863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:38.486427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:38.498219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 610/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:38.504871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:38.516593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:38.617387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7eda4-80b3-41e0-a373-74c7ce720ca3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:38.653868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:38.654525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:38.655032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:38.655390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:38.662899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:38.664930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:18:38.678437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:38.680398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:38.681522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:38.686462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 620/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:38.687822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:38.810195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd905e-6ac7-4696-acc7-83e31218aeae None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:38.857514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e3160-2382-4554-932e-c5fbc6e30434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:38.858164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3160-2382-4554-932e-c5fbc6e30434 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:38.858509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3160-2382-4554-932e-c5fbc6e30434 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:38.858781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e3160-2382-4554-932e-c5fbc6e30434 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:38.859528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e3160-2382-4554-932e-c5fbc6e30434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:38.859858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e3160-2382-4554-932e-c5fbc6e30434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:38.861505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e3160-2382-4554-932e-c5fbc6e30434 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:38.875892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 611/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:38.887019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:38.968936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:39.008939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a836d5-0e48-4b05-a85c-8716a5fa7951 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:39.045177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d216b2b-9c96-4ce9-846b-4c5e4383d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:39.045836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d216b2b-9c96-4ce9-846b-4c5e4383d27d None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:39.046147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d216b2b-9c96-4ce9-846b-4c5e4383d27d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:39.046424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d216b2b-9c96-4ce9-846b-4c5e4383d27d None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/632070e9f5534d54852df7f6f0d50461/roles/4da09e30141c409e82711c6915ca3cf1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:39.061628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d216b2b-9c96-4ce9-846b-4c5e4383d27d None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=632070e9f5534d54852df7f6f0d50461, role_id=4da09e30141c409e82711c6915ca3cf1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:39.063096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d216b2b-9c96-4ce9-846b-4c5e4383d27d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:39.076368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 621/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:18:38 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/632070e9f5534d54852df7f6f0d50461/roles/4da09e30141c409e82711c6915ca3cf1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:18:41.552864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec29e-2126-4049-ba91-856afc927fb6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:41.553467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec29e-2126-4049-ba91-856afc927fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:41.553467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec29e-2126-4049-ba91-856afc927fb6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:41.555430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 612/1233] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:18:41.560523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343c81-b3cc-437c-8a8f-f3d8c01578b1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:41.560944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343c81-b3cc-437c-8a8f-f3d8c01578b1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:41.561123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff343c81-b3cc-437c-8a8f-f3d8c01578b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:41.581383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ff343c81-b3cc-437c-8a8f-f3d8c01578b1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:18:41.582613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ff343c81-b3cc-437c-8a8f-f3d8c01578b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:18:41.654211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 622/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:18:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:18:41.933665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec29e-2126-4049-ba91-856afc927fb6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:41.962783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:42.049815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec29e-2126-4049-ba91-856afc927fb6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:42.090306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:42.091077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:42.091414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:42.091658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:42.103520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:18:42.109773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:42.111049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:42.112200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 613/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Fri Sep 30 19:18:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:42.117756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff343c81-b3cc-437c-8a8f-f3d8c01578b1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:42.174418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:42.233449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff343c81-b3cc-437c-8a8f-f3d8c01578b1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:42.269213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:42.269862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:42.270167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:42.270446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:42.271127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:42.271428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:42.272841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:42.281548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 623/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Fri Sep 30 19:18:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:42.287506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:42.386002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:42.402895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5bda7-126e-4aa1-8b90-71a1c465b913 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:42.445104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:42.445733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:42.446009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:42.446378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:42.458209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:42.459676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:42.476684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:42.477960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:42.479088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:42.479088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:42.479088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:42.479088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 614/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:42.483850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:42.597271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94ef4-946a-4969-8fd3-113e06ec22ed None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:42.607036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:42.634243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:42.634871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:42.635151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:42.635404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:42.636031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:42.636356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:42.637673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:42.659668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 624/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:42.660882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:42.789936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb352eb-6a75-427e-bc20-10d39509aae8 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:42.828406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:42.829166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:42.829446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:42.829725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:42.833277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:42.841344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:42.843430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:18:42.856959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:42.858176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:42.859174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 615/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:42.864318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:42.979698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43aee6-7743-46b3-9f89-113107c1603d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:43.019715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:43.020332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:43.020607 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:43.020876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:43.021734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:43.022144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:43.023965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:43.046163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 625/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 30 19:18:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:18:43.052147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:43.163551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6302085-903f-4ee7-9ba9-ea695c0fa74d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:43.202776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:43.203436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:43.203712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:43.203981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:43.276758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:43.284033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:43.285483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:43.396957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 616/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:18:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:18:43.402784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:43.434173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:43.517375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda03fdd-a948-47f6-8262-fd58dfa84c46 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:43.557697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:43.558359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:43.558634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:43.558903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:43.570370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:43.572313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:43.590463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:43.591617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:43.592569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:43.592569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:43.592569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:43.592569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 626/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:43.597844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:43.711632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:43.719350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695bde4-8e2b-46fa-8971-bd0f0be7a96c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:43.762336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:43.763019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:43.763307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:43.763636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:43.764517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:43.764898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:43.766492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:43.780334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 617/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:43.786591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:43.881118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:43.904542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7faa8f-a0d1-4c2c-b52e-2425ba27f606 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:43.941523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:43.942237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:43.942531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:43.942839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:43.951238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:43.952913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:18:43.964876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:43.965949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:43.966925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 627/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:43.972331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:44.087576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae33c00-016f-4760-8b41-5d09977fc235 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:44.124231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3f6bd-b023-46ba-9b8a-730f91ec5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:44.124905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3f6bd-b023-46ba-9b8a-730f91ec5a55 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:44.125184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3f6bd-b023-46ba-9b8a-730f91ec5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:44.125496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3f6bd-b023-46ba-9b8a-730f91ec5a55 None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:44.126246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3f6bd-b023-46ba-9b8a-730f91ec5a55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:44.126592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3f6bd-b023-46ba-9b8a-730f91ec5a55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:44.128151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3f6bd-b023-46ba-9b8a-730f91ec5a55 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:44.141391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 618/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:18:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:44.148178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:44.263726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6863d-3758-4d02-b622-1057093575fa None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:44.304512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dcf88-29b2-4c9b-a544-d2f8b3eca1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:44.305129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcf88-29b2-4c9b-a544-d2f8b3eca1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:44.305527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcf88-29b2-4c9b-a544-d2f8b3eca1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:44.305801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcf88-29b2-4c9b-a544-d2f8b3eca1c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:44.306787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dcf88-29b2-4c9b-a544-d2f8b3eca1c4 None admin] RBAC: Adding query filter params (role.id=4da09e30141c409e82711c6915ca3cf1, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=632070e9f5534d54852df7f6f0d50461) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:44.307015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dcf88-29b2-4c9b-a544-d2f8b3eca1c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:44.308701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dcf88-29b2-4c9b-a544-d2f8b3eca1c4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:44.315630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 628/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:18:44 2022] GET /identity/v3/role_assignments?user.id=632070e9f5534d54852df7f6f0d50461&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=4da09e30141c409e82711c6915ca3cf1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:46.598669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c9235-14c4-4231-94f7-44a7aa1caabd None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:46.599220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c9235-14c4-4231-94f7-44a7aa1caabd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:46.599220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c9235-14c4-4231-94f7-44a7aa1caabd None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:46.601129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 619/1247] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:18:46.607229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6377ad6-6497-4191-9781-88cc51eb6662 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:46.607686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6377ad6-6497-4191-9781-88cc51eb6662 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:46.607807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6377ad6-6497-4191-9781-88cc51eb6662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:46.613916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:46.628240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c6377ad6-6497-4191-9781-88cc51eb6662 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:18:46.629416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c6377ad6-6497-4191-9781-88cc51eb6662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:18:46.705652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 629/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:18:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:18:47.021682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c9235-14c4-4231-94f7-44a7aa1caabd None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:47.050222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:47.162078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c9235-14c4-4231-94f7-44a7aa1caabd None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:47.199516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:47.200163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:47.200442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:47.200711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:47.213543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:18:47.218550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:47.219752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:47.220813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 620/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:18:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:47.226635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6377ad6-6497-4191-9781-88cc51eb6662 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:47.329810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6377ad6-6497-4191-9781-88cc51eb6662 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:47.361922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:47.368255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:47.368885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:47.369158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:47.369423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:47.370118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:47.370420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:47.371788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:47.380633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 630/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:47.387398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:47.470692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:47.499411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11645c73-7b50-4c3a-9514-8c171aa6f09c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:47.534483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:47.535108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:47.535387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:47.535655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:47.546481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:47.547914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:47.561820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:47.562880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:47.563826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:47.563826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:47.563826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:47.563826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 621/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:47.568670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:47.672464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685523a-e0c2-477c-b92a-925c80c15b37 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:47.710596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:47.711061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:47.711347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:47.711627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:47.712298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:47.712585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:47.713941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:47.727604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 631/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:47.735096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:47.841070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb43d6-fbbe-433d-a2ae-9315d1850e7e None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:47.866843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:47.874953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:47.875578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:47.875860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:47.876135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:47.883992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:47.885435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:18:47.896301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:47.897908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:47.899151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 622/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:47.903200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:47.957053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:48.000973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f2d08-91b8-4201-a9e0-3748037dec74 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:48.033587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:48.034209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:48.034490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:48.034762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:48.035479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:48.035785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:48.037201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:48.054758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 632/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 30 19:18:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:48.060280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:48.159756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea122-f502-48f8-a3ab-4fd7ed9e09c9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:48.191966 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:48.192558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:48.192833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:48.193104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:48.246233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:48.259112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:48.260556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:48.355413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 623/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:18:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 30 19:18:48.361180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:48.459201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b5b72-297a-4c00-a97f-7f806082b6d8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:48.472639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:48.494924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:48.495547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:48.495827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:48.496101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:48.505882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:48.507849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:48.522142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:48.523498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:48.524616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:48.524616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:48.524616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:48.524902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 633/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:48.530713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:48.614365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:48.626877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb8803-af38-44d8-a430-473ca02500cd None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:48.659685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:48.660273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:48.660547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:48.660814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:48.661432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:48.661726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:48.663326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:48.674020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 624/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:18:48.680438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:48.781820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13294ea0-381b-41cb-b0b7-3681ee430332 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:48.814588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:48.815208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:48.815486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:48.815758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:48.822292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:48.823723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:18:48.835529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:48.836606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:48.837580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 634/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:48.842622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:48.939163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323f28-9923-455d-9b57-15b4bec241ec None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:48.971677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd9fef-eb64-497c-96c3-32008a80946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:48.972265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9fef-eb64-497c-96c3-32008a80946a None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:48.972540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9fef-eb64-497c-96c3-32008a80946a None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:48.972809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd9fef-eb64-497c-96c3-32008a80946a None admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:48.973480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9fef-eb64-497c-96c3-32008a80946a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:48.973780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9fef-eb64-497c-96c3-32008a80946a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:48.975889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd9fef-eb64-497c-96c3-32008a80946a None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:48.987591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 625/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:48.994779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:49.019791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:49.094172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ad757-d439-4702-90d4-433484a84896 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:49.127122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0e8e4-1da4-49b9-ae51-bb5027c1d791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:49.127716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0e8e4-1da4-49b9-ae51-bb5027c1d791 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:49.127992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0e8e4-1da4-49b9-ae51-bb5027c1d791 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:49.128261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0e8e4-1da4-49b9-ae51-bb5027c1d791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:49.128974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0e8e4-1da4-49b9-ae51-bb5027c1d791 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=632070e9f5534d54852df7f6f0d50461) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:49.129281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0e8e4-1da4-49b9-ae51-bb5027c1d791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:49.130718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0e8e4-1da4-49b9-ae51-bb5027c1d791 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:49.136237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 635/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:18:48 2022] GET /identity/v3/role_assignments?user.id=632070e9f5534d54852df7f6f0d50461&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:51.249815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75a50-52a0-496c-9785-b31f376e3f12 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:51.250432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75a50-52a0-496c-9785-b31f376e3f12 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:51.250432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75a50-52a0-496c-9785-b31f376e3f12 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:51.251693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 626/1261] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:18:51.256943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc79b-6203-43c3-b451-b9b54e214436 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:51.257329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc79b-6203-43c3-b451-b9b54e214436 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:51.257503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bc79b-6203-43c3-b451-b9b54e214436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:51.275366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-213bc79b-6203-43c3-b451-b9b54e214436 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:18:51.276553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-213bc79b-6203-43c3-b451-b9b54e214436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:18:51.341830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 636/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:18:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:18:51.609415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c75a50-52a0-496c-9785-b31f376e3f12 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:51.620874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:51.716152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c75a50-52a0-496c-9785-b31f376e3f12 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:51.756222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:51.757073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:51.757386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:51.757652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:51.769400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:18:51.774643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:51.775862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:51.776728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 627/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:51.781858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bc79b-6203-43c3-b451-b9b54e214436 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:51.800429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:51.880889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bc79b-6203-43c3-b451-b9b54e214436 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:51.915066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:51.915662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:51.915939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:51.916211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:51.916865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:51.917166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:51.918543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:51.926284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 637/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:51.933125 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:51.997805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:52.029591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e587af-0cab-4b65-a252-dcf4b52669f9 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:52.063095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:52.063723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:52.063999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:52.064272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:52.074506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:52.075945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:52.090774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:52.091907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:52.092833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:52.092833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:52.092833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:52.092833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 628/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:52.097610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:52.180598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:52.199340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212299b-2862-4585-9592-29cb4e7d6954 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:52.233066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:52.233659 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:52.233935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:52.234236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:52.234865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:52.235162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:52.236515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:52.248113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 638/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:18:52.253756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:52.351268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bdd31-c970-4f4e-8e4a-78169339f8cf None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:52.370121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:52.383830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:52.384436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:52.384709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:52.384975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:52.392045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:52.393454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:18:52.404586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:52.405756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:52.406968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 629/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:52.411307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:52.508909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2053ff5-2afc-458b-80bc-49742989e3e0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:52.541316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:52.541904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:52.542209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:52.542480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:52.543186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:52.543487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:52.544894 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:52.553249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:52.562671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 639/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 30 19:18:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:52.569097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:52.665295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560056-933d-4d1b-b0b0-c8db1860d8e8 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:52.701902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:52.702624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:52.703057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:52.703406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:52.718325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:52.719930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:52.733569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:52.734721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:52.735813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:52.735813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:52.735813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:52.735813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 630/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:52.740557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:52.837418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bec241-687b-40d0-bb3d-514031491816 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:52.870537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:52.871123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:52.871396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:52.871662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:52.872284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:52.872580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:52.873915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:52.885383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 640/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:52.890940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:52.921407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:52.987599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6037d-2395-4a30-bf1f-f3b9f61ae1f4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:53.020482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:53.021082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:53.021357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:53.021965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:53.028092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:53.029511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:18:53.040455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:53.041500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:53.042523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 631/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:53.047265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:53.105091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:53.148357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14cc7e-b2fa-4094-a8b1-2cef3f0c5e47 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:53.181157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615470-5b46-476b-95c2-1e11c98178a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:53.181749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615470-5b46-476b-95c2-1e11c98178a4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:53.182027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615470-5b46-476b-95c2-1e11c98178a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:53.182326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615470-5b46-476b-95c2-1e11c98178a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:53.183008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615470-5b46-476b-95c2-1e11c98178a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:53.183312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615470-5b46-476b-95c2-1e11c98178a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:53.184726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615470-5b46-476b-95c2-1e11c98178a4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:53.197090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 641/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:53.203117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:53.291466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:53.300671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4416c-6ba1-4fda-be26-38aff22b8a68 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:53.333032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84175b33-e0fe-45fe-89b3-e219b5466ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:53.333696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175b33-e0fe-45fe-89b3-e219b5466ca9 None admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:53.333991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175b33-e0fe-45fe-89b3-e219b5466ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:53.334582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175b33-e0fe-45fe-89b3-e219b5466ca9 None admin] PATH_INFO: `/v3/projects/5618831a00444e17a2b85a876ed782be/users/632070e9f5534d54852df7f6f0d50461/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:53.336186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175b33-e0fe-45fe-89b3-e219b5466ca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5618831a00444e17a2b85a876ed782be, user_id=632070e9f5534d54852df7f6f0d50461, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:53.337601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175b33-e0fe-45fe-89b3-e219b5466ca9 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:53.350429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 632/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Fri Sep 30 19:18:53 2022] PUT /identity/v3/projects/5618831a00444e17a2b85a876ed782be/users/632070e9f5534d54852df7f6f0d50461/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:18:55.539342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef230-5322-4641-a32a-9c2f75c8270e None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:55.539845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef230-5322-4641-a32a-9c2f75c8270e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:55.539845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef230-5322-4641-a32a-9c2f75c8270e None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:55.541130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 642/1274] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:18:55.546213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9946d-ffeb-4d45-8dd3-b2a5afaf43aa None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:55.546654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9946d-ffeb-4d45-8dd3-b2a5afaf43aa None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:55.546748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9946d-ffeb-4d45-8dd3-b2a5afaf43aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:55.564514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-91f9946d-ffeb-4d45-8dd3-b2a5afaf43aa None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:18:55.565704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-91f9946d-ffeb-4d45-8dd3-b2a5afaf43aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:18:55.630313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 633/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:18:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:18:55.916519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef230-5322-4641-a32a-9c2f75c8270e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:56.017237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef230-5322-4641-a32a-9c2f75c8270e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:56.034294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:56.050979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:56.051593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:56.051876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:56.052150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:56.063326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 30 19:18:56.068770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:56.069941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:56.070885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 643/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Fri Sep 30 19:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:56.076162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9946d-ffeb-4d45-8dd3-b2a5afaf43aa None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:56.154977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:56.173788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9946d-ffeb-4d45-8dd3-b2a5afaf43aa None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:56.207407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:56.207990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:56.208265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:56.208532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:56.209402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:56.209702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:56.211082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:56.218741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 634/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Fri Sep 30 19:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:56.225094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:56.322022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45de0b-5bf8-4319-84f1-676c40fbeaee None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:56.354530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:56.355146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:56.355427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:56.355701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:56.365848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:56.367294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:56.381600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:56.382789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:56.383742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:56.383742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:56.383742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:56.383742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 644/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:56.388261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:56.487738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a407c-0b39-414f-8254-ba3f2a45330c None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:56.520814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:56.522500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:56.522784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:56.523052 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:56.523678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:56.523976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:56.525320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:56.536544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 635/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:56.542972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:56.575496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:56.643393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7608b9-5abb-4d16-ba81-c0fbfa519320 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:56.675071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:56.675683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:56.675962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:56.676234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:56.683950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:56.685369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 30 19:18:56.697691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:56.698878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:18:56.700070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 645/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 30 19:18:56.704549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:56.708339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:56.801598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817f704-f0e4-4861-8d8f-6f93e9c5819d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:56.833589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:56.834832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:56.835060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:56.835323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:56.836023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:56.836321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:56.837726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:56.854571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 636/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Fri Sep 30 19:18:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:56.860320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:56.949106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:56.958768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1103fd-3e8c-444b-abdd-986fe06116e1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:56.991600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:56.992182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:56.992454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:56.992974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:57.057952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:57.059415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:57.143682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:57.153803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 646/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Fri Sep 30 19:18:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 30 19:18:57.159668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:57.220664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:57.260259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b121c8d-7093-4955-8be9-24dabe99128d None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:57.293893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:57.294541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:57.294822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:57.295093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:57.305828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:57.307284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 30 19:18:57.321777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:57.322952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 30 19:18:57.324079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 30 19:18:57.324079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 30 19:18:57.324079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:57.324079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 637/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:57.328447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:57.424797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ec2df-6192-44ca-866e-f2d3014d19a4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:57.456616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:57.457201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:57.457474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:57.457739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:57.458394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:57.459205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:57.460540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:57.471279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 647/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Fri Sep 30 19:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:57.477344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:57.574950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a8233-bfd6-4ae0-94aa-5fcecc187584 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:57.588472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:57.608848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:57.609471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:57.609752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:57.610023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:57.617002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:57.618731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 30 19:18:57.629636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application with Lock( Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:18:57.631152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: ERROR keystone.server.flask.application Sep 30 19:18:57.632146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 638/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Fri Sep 30 19:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:18:57.637289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:57.685920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:18:57.736467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c657-a01d-4ff7-bd5a-6789a9661074 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:57.769567 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea5458-e634-4db7-8a9b-9bcdb5e22c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:57.770183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea5458-e634-4db7-8a9b-9bcdb5e22c81 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:57.770469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea5458-e634-4db7-8a9b-9bcdb5e22c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:57.770740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea5458-e634-4db7-8a9b-9bcdb5e22c81 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:57.775121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea5458-e634-4db7-8a9b-9bcdb5e22c81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:57.775443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea5458-e634-4db7-8a9b-9bcdb5e22c81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:57.777539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea5458-e634-4db7-8a9b-9bcdb5e22c81 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:57.794149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 648/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Fri Sep 30 19:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:18:57.800290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:18:57.900576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6abde8f-b99c-4780-91ea-76b5cfe1a6a4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:18:57.933909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d95ac0-0430-4a3d-8670-80fb90f78713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:18:57.934527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95ac0-0430-4a3d-8670-80fb90f78713 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:18:57.934807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95ac0-0430-4a3d-8670-80fb90f78713 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:18:57.935083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d95ac0-0430-4a3d-8670-80fb90f78713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:18:57.935795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d95ac0-0430-4a3d-8670-80fb90f78713 None admin] RBAC: Adding query filter params (role.id=cb2d2c8aadb342ac970c4bb846301c1d, scope.project.id=5618831a00444e17a2b85a876ed782be, user.id=632070e9f5534d54852df7f6f0d50461) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:18:57.936099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d95ac0-0430-4a3d-8670-80fb90f78713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:18:57.937525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d95ac0-0430-4a3d-8670-80fb90f78713 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:18:57.943323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 639/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Fri Sep 30 19:18:57 2022] GET /identity/v3/role_assignments?user.id=632070e9f5534d54852df7f6f0d50461&scope.project.id=5618831a00444e17a2b85a876ed782be&role.id=cb2d2c8aadb342ac970c4bb846301c1d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:19:00.091410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bbe5-5805-4d97-97ba-2c1b904197df None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:00.091873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bbe5-5805-4d97-97ba-2c1b904197df None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:00.091995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319bbe5-5805-4d97-97ba-2c1b904197df None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:00.093393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 649/1288] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:19:00.098607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4426e57-85db-4cd4-a598-dd39c003936e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:00.099075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4426e57-85db-4cd4-a598-dd39c003936e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:00.099215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4426e57-85db-4cd4-a598-dd39c003936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:00.117083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e4426e57-85db-4cd4-a598-dd39c003936e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:19:00.118561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e4426e57-85db-4cd4-a598-dd39c003936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:19:00.147467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:00.184664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 640/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:19:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:19:00.451705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319bbe5-5805-4d97-97ba-2c1b904197df None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:00.550614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319bbe5-5805-4d97-97ba-2c1b904197df None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:00.561349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:00.584737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:00.585354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:00.585633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:00.585903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:00.586496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:00.587843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:19:00.596307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:19:00.597503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:00.598422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 650/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:19:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:19:00.604243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4426e57-85db-4cd4-a598-dd39c003936e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:00.701561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4426e57-85db-4cd4-a598-dd39c003936e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:00.739046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd75d34-03c5-4496-a93e-cb32656b4b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:00.740123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75d34-03c5-4496-a93e-cb32656b4b92 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:00.740426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75d34-03c5-4496-a93e-cb32656b4b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:00.740702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75d34-03c5-4496-a93e-cb32656b4b92 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:00.741332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd75d34-03c5-4496-a93e-cb32656b4b92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:19:00.741636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd75d34-03c5-4496-a93e-cb32656b4b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:00.743299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd75d34-03c5-4496-a93e-cb32656b4b92 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:00.748756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 641/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 30 19:19:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:19:00.754819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:00.857882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9619246-bade-41c5-956e-df33dffcc371 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:00.895527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e232d1-b25d-4fa5-9d37-ace496d43541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:00.896959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e232d1-b25d-4fa5-9d37-ace496d43541 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:00.897358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e232d1-b25d-4fa5-9d37-ace496d43541 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:00.897629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e232d1-b25d-4fa5-9d37-ace496d43541 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:00.898282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e232d1-b25d-4fa5-9d37-ace496d43541 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:19:00.898585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e232d1-b25d-4fa5-9d37-ace496d43541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:00.899934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e232d1-b25d-4fa5-9d37-ace496d43541 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:00.904223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 651/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 30 19:19:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:19:03.038529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7662db-e55a-49da-9af5-1317aa9b82e0 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:03.039100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7662db-e55a-49da-9af5-1317aa9b82e0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:03.039100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7662db-e55a-49da-9af5-1317aa9b82e0 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:03.040415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 642/1293] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:19:03.045670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd99a9-fb6e-4fd2-9ce2-506f4e395166 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:03.046095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd99a9-fb6e-4fd2-9ce2-506f4e395166 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:03.046246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd99a9-fb6e-4fd2-9ce2-506f4e395166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:03.064620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-65bd99a9-fb6e-4fd2-9ce2-506f4e395166 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:19:03.065788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-65bd99a9-fb6e-4fd2-9ce2-506f4e395166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:19:03.096198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:03.133200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 652/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:19:03.395216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7662db-e55a-49da-9af5-1317aa9b82e0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:03.426680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:03.496439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7662db-e55a-49da-9af5-1317aa9b82e0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:03.529584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a55c6c-aeed-4172-a058-93ead3c9d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:03.530214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a55c6c-aeed-4172-a058-93ead3c9d2c2 None admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:03.530496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a55c6c-aeed-4172-a058-93ead3c9d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:03.530773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a55c6c-aeed-4172-a058-93ead3c9d2c2 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:03.531420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a55c6c-aeed-4172-a058-93ead3c9d2c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:03.532783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a55c6c-aeed-4172-a058-93ead3c9d2c2 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:03.547238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 643/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Fri Sep 30 19:19:03 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:19:05.701321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f36f1-cc14-420c-8975-2b20faf177f5 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:05.701862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f36f1-cc14-420c-8975-2b20faf177f5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:05.701862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f36f1-cc14-420c-8975-2b20faf177f5 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:05.703229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 653/1296] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:19:05.709547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4dd31-1cd3-4468-adde-f7a90a42da65 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:05.710404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4dd31-1cd3-4468-adde-f7a90a42da65 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:05.710725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4dd31-1cd3-4468-adde-f7a90a42da65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:05.730526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-6ea4dd31-1cd3-4468-adde-f7a90a42da65 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:19:05.731708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6ea4dd31-1cd3-4468-adde-f7a90a42da65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:19:05.806878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 644/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:19:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 30 19:19:06.077376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f36f1-cc14-420c-8975-2b20faf177f5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:06.176128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f36f1-cc14-420c-8975-2b20faf177f5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:06.208638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:06.209244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:06.209520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:06.209789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:06.210388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:06.211737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:19:06.220167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:19:06.221366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:06.222460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 654/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:19:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:19:06.227986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4dd31-1cd3-4468-adde-f7a90a42da65 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:06.246488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:06.326170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4dd31-1cd3-4468-adde-f7a90a42da65 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:06.359424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:06.360017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:06.360295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:06.360568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:06.361184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:19:06.361483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:06.362870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:06.368180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 645/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 30 19:19:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:19:06.374006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:06.405696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:06.472150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ed65b-ee7a-433d-afaa-2e94ff633f07 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:06.504661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb037a1f-e1b8-4867-b546-2d8b589e84af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:06.505348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037a1f-e1b8-4867-b546-2d8b589e84af None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:06.505626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037a1f-e1b8-4867-b546-2d8b589e84af None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:06.505895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb037a1f-e1b8-4867-b546-2d8b589e84af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:06.506611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb037a1f-e1b8-4867-b546-2d8b589e84af None admin] RBAC: Adding query filter params (interface=public, service_id=402352da92f844f5a515dca0fa49e197, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:19:06.506918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb037a1f-e1b8-4867-b546-2d8b589e84af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:06.508271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb037a1f-e1b8-4867-b546-2d8b589e84af None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:06.513080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 655/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Fri Sep 30 19:19:06 2022] GET /identity/v3/endpoints?service_id=402352da92f844f5a515dca0fa49e197&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:19:06.518589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:06.597442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:06.617209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03832271-70c2-4d6b-ba2f-b939df04c6d4 None admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:06.652459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5aff-13e4-4ae1-ac25-e1ac93ab5205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:06.653051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5aff-13e4-4ae1-ac25-e1ac93ab5205 None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:06.653335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5aff-13e4-4ae1-ac25-e1ac93ab5205 None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:06.653606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5aff-13e4-4ae1-ac25-e1ac93ab5205 None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:06.654226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5aff-13e4-4ae1-ac25-e1ac93ab5205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:06.655587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5aff-13e4-4ae1-ac25-e1ac93ab5205 None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:06.662718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 646/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Fri Sep 30 19:19:06 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:19:08.813162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0580b-f814-492b-b46e-4974b0a68afe None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:08.813730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0580b-f814-492b-b46e-4974b0a68afe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:08.813730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0580b-f814-492b-b46e-4974b0a68afe None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:08.815095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 656/1302] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:19:08.820960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df7ba-bbb1-4738-bd7a-b8d94a79e816 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:08.821395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df7ba-bbb1-4738-bd7a-b8d94a79e816 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:08.821395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789df7ba-bbb1-4738-bd7a-b8d94a79e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:08.839672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-789df7ba-bbb1-4738-bd7a-b8d94a79e816 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:19:08.840834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-789df7ba-bbb1-4738-bd7a-b8d94a79e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:19:08.905182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 647/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:19:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 30 19:19:09.176442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0580b-f814-492b-b46e-4974b0a68afe None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:09.270026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:09.276713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0580b-f814-492b-b46e-4974b0a68afe None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:09.309056 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:09.309665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:09.309937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:09.310237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:09.310810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:09.312151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 30 19:19:09.320687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 30 19:19:09.321954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 30 19:19:09.323295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 657/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Fri Sep 30 19:19:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 30 19:19:09.327700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df7ba-bbb1-4738-bd7a-b8d94a79e816 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:09.401687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:09.424894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789df7ba-bbb1-4738-bd7a-b8d94a79e816 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:09.460049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f947ec-5ef5-4502-97af-3235f736b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:09.460584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f947ec-5ef5-4502-97af-3235f736b8db None admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:09.460866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f947ec-5ef5-4502-97af-3235f736b8db None admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:09.461143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f947ec-5ef5-4502-97af-3235f736b8db None admin] PATH_INFO: `/v3/services` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:09.463895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f947ec-5ef5-4502-97af-3235f736b8db None admin] RBAC: Adding query filter params (name=placement) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:19:09.464222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f947ec-5ef5-4502-97af-3235f736b8db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:09.467851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f947ec-5ef5-4502-97af-3235f736b8db None admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:09.473258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 648/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Fri Sep 30 19:19:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:19:09.479621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:19:09.576634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7dbeac-ea4c-43ec-af7b-4e16f5867c18 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:19:09.610131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b458e39-921a-48fe-856b-43984712a557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:19:09.610720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458e39-921a-48fe-856b-43984712a557 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:19:09.611000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458e39-921a-48fe-856b-43984712a557 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:19:09.611272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458e39-921a-48fe-856b-43984712a557 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:19:09.611936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b458e39-921a-48fe-856b-43984712a557 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:19:09.613285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b458e39-921a-48fe-856b-43984712a557 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:19:09.632248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 658/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:19:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:19:19.470461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=30 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:19:19.629037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:14.079481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de15f-30a0-4959-b6a0-d79568b18a32 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:14.080528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de15f-30a0-4959-b6a0-d79568b18a32 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:14.081229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de15f-30a0-4959-b6a0-d79568b18a32 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:14.083130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 649/1307] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:14.089149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab74a1-218f-46b2-bd31-a6c254dfdf36 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:14.089604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab74a1-218f-46b2-bd31-a6c254dfdf36 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:14.090485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab74a1-218f-46b2-bd31-a6c254dfdf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:14.264249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-98ab74a1-218f-46b2-bd31-a6c254dfdf36 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:14.269861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-98ab74a1-218f-46b2-bd31-a6c254dfdf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:14.440222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 659/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:14.833073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c2a32-8e19-4b76-999e-b24378a3f48c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:14.833354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c2a32-8e19-4b76-999e-b24378a3f48c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:14.833795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c2a32-8e19-4b76-999e-b24378a3f48c None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:14.835638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 650/1309] 10.222.0.18 () {54 vars in 964 bytes} [Fri Sep 30 19:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:14.843962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761aae-1beb-414c-9854-260752a35aef None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:14.843962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761aae-1beb-414c-9854-260752a35aef None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:14.843962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b761aae-1beb-414c-9854-260752a35aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:14.952816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6b761aae-1beb-414c-9854-260752a35aef None None] MFA Rules not processed for user `38287d3f91704657bc26c5b4d50c0315`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:14.953948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6b761aae-1beb-414c-9854-260752a35aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:14.976203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:15.037562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 660/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Fri Sep 30 19:20:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:15.046832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c2a32-8e19-4b76-999e-b24378a3f48c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:15.048588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-248c2a32-8e19-4b76-999e-b24378a3f48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:15.169761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c2a32-8e19-4b76-999e-b24378a3f48c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:15.251893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eb985-bb7e-4d42-81bb-d21dc91c80a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:15.252514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb985-bb7e-4d42-81bb-d21dc91c80a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:15.252793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb985-bb7e-4d42-81bb-d21dc91c80a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:15.253065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb985-bb7e-4d42-81bb-d21dc91c80a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:15.254812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-950eb985-bb7e-4d42-81bb-d21dc91c80a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:15.318323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:15.375915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eb985-bb7e-4d42-81bb-d21dc91c80a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:15.377342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eb985-bb7e-4d42-81bb-d21dc91c80a9 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:15.396602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 651/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:17.896013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb0ca-9be7-4587-8bc7-c8d1844f6336 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:17.896589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb0ca-9be7-4587-8bc7-c8d1844f6336 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:17.896589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffb0ca-9be7-4587-8bc7-c8d1844f6336 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:17.897914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 661/1312] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:17.911351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c172b0-6ec7-471f-aa44-9bcb5798e53a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:17.911789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c172b0-6ec7-471f-aa44-9bcb5798e53a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:17.911906 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c172b0-6ec7-471f-aa44-9bcb5798e53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:17.984548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-65c172b0-6ec7-471f-aa44-9bcb5798e53a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:17.985760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-65c172b0-6ec7-471f-aa44-9bcb5798e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:18.087105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 652/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:18.387885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85febf-996e-4df1-8860-c609321fad28 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:18.388201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85febf-996e-4df1-8860-c609321fad28 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:18.388478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85febf-996e-4df1-8860-c609321fad28 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:18.390964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 662/1314] 10.222.0.18 () {54 vars in 964 bytes} [Fri Sep 30 19:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:18.397015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f043e-b419-4f47-8768-57edf5864039 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:18.397305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f043e-b419-4f47-8768-57edf5864039 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:18.397579 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f043e-b419-4f47-8768-57edf5864039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:18.409628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:18.475193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-cc5f043e-b419-4f47-8768-57edf5864039 None None] MFA Rules not processed for user `38287d3f91704657bc26c5b4d50c0315`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:18.476400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cc5f043e-b419-4f47-8768-57edf5864039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:18.550189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 653/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Fri Sep 30 19:20:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:18.559323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85febf-996e-4df1-8860-c609321fad28 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:18.560840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7b85febf-996e-4df1-8860-c609321fad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:18.665981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85febf-996e-4df1-8860-c609321fad28 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:18.737726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:18.740369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9b4f2-7a3b-49c6-8ee7-56e2cbfac85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:18.741193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b4f2-7a3b-49c6-8ee7-56e2cbfac85b service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:18.741630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b4f2-7a3b-49c6-8ee7-56e2cbfac85b service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:18.741950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b4f2-7a3b-49c6-8ee7-56e2cbfac85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:18.743778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-faf9b4f2-7a3b-49c6-8ee7-56e2cbfac85b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:18.851374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b4f2-7a3b-49c6-8ee7-56e2cbfac85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:18.852810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b4f2-7a3b-49c6-8ee7-56e2cbfac85b service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:18.871970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 663/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:21.553127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1e0c-ebb3-40b8-85a0-fbf3be1db6a0 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:21.553657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1e0c-ebb3-40b8-85a0-fbf3be1db6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:21.553657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b1e0c-ebb3-40b8-85a0-fbf3be1db6a0 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:21.555043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 654/1317] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:21.560208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9cfc-0bcb-4e4e-b33c-17991b48096c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:21.560698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9cfc-0bcb-4e4e-b33c-17991b48096c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:21.560863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9cfc-0bcb-4e4e-b33c-17991b48096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:21.627115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b21a9cfc-0bcb-4e4e-b33c-17991b48096c None None] MFA Rules not processed for user `c80b3f74e31e4f3ca3cd505bd487d055`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:21.628247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b21a9cfc-0bcb-4e4e-b33c-17991b48096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:21.679581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:21.723962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 664/1318] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:22.014403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b1e0c-ebb3-40b8-85a0-fbf3be1db6a0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:22.016007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cf9b1e0c-ebb3-40b8-85a0-fbf3be1db6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:22.122484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b1e0c-ebb3-40b8-85a0-fbf3be1db6a0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:22.125239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:22.194817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699b00c-2233-4fc0-96c4-2f20ceb9c308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:22.195410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b00c-2233-4fc0-96c4-2f20ceb9c308 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:22.195683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b00c-2233-4fc0-96c4-2f20ceb9c308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:22.195950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b00c-2233-4fc0-96c4-2f20ceb9c308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:22.197511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9699b00c-2233-4fc0-96c4-2f20ceb9c308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:22.302682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699b00c-2233-4fc0-96c4-2f20ceb9c308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:22.304425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699b00c-2233-4fc0-96c4-2f20ceb9c308 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:22.322183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 655/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:25.064341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c0c5-f078-4fdc-88b5-6f2ff2b370e7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:25.064777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c0c5-f078-4fdc-88b5-6f2ff2b370e7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:25.064876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359c0c5-f078-4fdc-88b5-6f2ff2b370e7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:25.066279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 665/1320] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:25.071729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdc550-1df9-43d9-af35-9f1abc8f9151 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:25.072136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdc550-1df9-43d9-af35-9f1abc8f9151 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:25.072306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdc550-1df9-43d9-af35-9f1abc8f9151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:25.115036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:25.142698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-50bdc550-1df9-43d9-af35-9f1abc8f9151 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:25.143896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-50bdc550-1df9-43d9-af35-9f1abc8f9151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:25.244677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 656/1321] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:25.530514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c0c5-f078-4fdc-88b5-6f2ff2b370e7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:25.532054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3359c0c5-f078-4fdc-88b5-6f2ff2b370e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:25.634005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359c0c5-f078-4fdc-88b5-6f2ff2b370e7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:25.709630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36451d6-3c4a-43c5-8d36-fe1c6534cf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:25.710365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36451d6-3c4a-43c5-8d36-fe1c6534cf4d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:25.710766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36451d6-3c4a-43c5-8d36-fe1c6534cf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:25.711158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36451d6-3c4a-43c5-8d36-fe1c6534cf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:25.713417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c36451d6-3c4a-43c5-8d36-fe1c6534cf4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:25.723154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:25.822566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36451d6-3c4a-43c5-8d36-fe1c6534cf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:25.823978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36451d6-3c4a-43c5-8d36-fe1c6534cf4d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:25.842951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 666/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:28.681708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4636c-fdb9-4931-a649-c60b64e96f27 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:28.682357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4636c-fdb9-4931-a649-c60b64e96f27 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:28.682357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4636c-fdb9-4931-a649-c60b64e96f27 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:28.683614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 657/1323] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:28.689594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab5cb-ac3f-4261-aab8-fbf5d8e86b41 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:28.689993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab5cb-ac3f-4261-aab8-fbf5d8e86b41 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:28.690178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ab5cb-ac3f-4261-aab8-fbf5d8e86b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:28.763825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-641ab5cb-ac3f-4261-aab8-fbf5d8e86b41 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:28.765099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-641ab5cb-ac3f-4261-aab8-fbf5d8e86b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:28.829153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:28.873332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 667/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:29.154785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4636c-fdb9-4931-a649-c60b64e96f27 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:29.156373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c8e4636c-fdb9-4931-a649-c60b64e96f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:29.261392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4636c-fdb9-4931-a649-c60b64e96f27 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:29.274994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:29.340872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd943e-685f-44e8-9b24-143cc22c3900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:29.341680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd943e-685f-44e8-9b24-143cc22c3900 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:29.341901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd943e-685f-44e8-9b24-143cc22c3900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:29.342289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd943e-685f-44e8-9b24-143cc22c3900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:29.344041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-48bd943e-685f-44e8-9b24-143cc22c3900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:29.451476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd943e-685f-44e8-9b24-143cc22c3900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:29.453013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd943e-685f-44e8-9b24-143cc22c3900 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:29.470728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 658/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:31.714438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045e25b-7c51-4432-bf6f-0637718cdab7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:31.714973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045e25b-7c51-4432-bf6f-0637718cdab7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:31.714973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045e25b-7c51-4432-bf6f-0637718cdab7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:31.716872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 668/1326] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:31.722621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b8853-6f46-41e7-9922-f6af6468ba15 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:31.723071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b8853-6f46-41e7-9922-f6af6468ba15 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:31.723289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b8853-6f46-41e7-9922-f6af6468ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:31.773053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:31.792653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d75b8853-6f46-41e7-9922-f6af6468ba15 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:31.793853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d75b8853-6f46-41e7-9922-f6af6468ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:31.900330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 659/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:32.183793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045e25b-7c51-4432-bf6f-0637718cdab7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:32.185571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5045e25b-7c51-4432-bf6f-0637718cdab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:32.288550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045e25b-7c51-4432-bf6f-0637718cdab7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:32.363469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951b28f-98cc-4211-8172-8d437d8bcb41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:32.364088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951b28f-98cc-4211-8172-8d437d8bcb41 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:32.364369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951b28f-98cc-4211-8172-8d437d8bcb41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:32.364645 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951b28f-98cc-4211-8172-8d437d8bcb41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:32.366259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f951b28f-98cc-4211-8172-8d437d8bcb41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:32.383991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:32.478349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951b28f-98cc-4211-8172-8d437d8bcb41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:32.479700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951b28f-98cc-4211-8172-8d437d8bcb41 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:32.500395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 669/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:34.713446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b618a-cdb7-4104-8302-fe848130e066 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:34.713968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b618a-cdb7-4104-8302-fe848130e066 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:34.714087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b618a-cdb7-4104-8302-fe848130e066 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:34.715400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 660/1329] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:34.720794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a01d67-45ef-4652-9eea-7e4b37d9b265 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:34.721221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a01d67-45ef-4652-9eea-7e4b37d9b265 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:34.721349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a01d67-45ef-4652-9eea-7e4b37d9b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:34.790187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-15a01d67-45ef-4652-9eea-7e4b37d9b265 None None] MFA Rules not processed for user `c80b3f74e31e4f3ca3cd505bd487d055`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:34.791328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-15a01d67-45ef-4652-9eea-7e4b37d9b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:34.856133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:34.889982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 670/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:35.173977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b618a-cdb7-4104-8302-fe848130e066 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:35.175533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ac9b618a-cdb7-4104-8302-fe848130e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:35.288219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b618a-cdb7-4104-8302-fe848130e066 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:35.314249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:35.378634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617288a-56b8-4220-a381-d4fc0fa7d9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:35.379254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617288a-56b8-4220-a381-d4fc0fa7d9bd service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:35.379534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617288a-56b8-4220-a381-d4fc0fa7d9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:35.379807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617288a-56b8-4220-a381-d4fc0fa7d9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:35.381416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f617288a-56b8-4220-a381-d4fc0fa7d9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:35.505076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617288a-56b8-4220-a381-d4fc0fa7d9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:35.506944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617288a-56b8-4220-a381-d4fc0fa7d9bd service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:35.529315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 661/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:38.127612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb0c4-7cd5-41dc-a4e6-d6032f7ba960 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:38.128150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb0c4-7cd5-41dc-a4e6-d6032f7ba960 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:38.128150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfb0c4-7cd5-41dc-a4e6-d6032f7ba960 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:38.129531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 671/1332] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:38.134800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bc47a-8467-499d-8c36-83d6d469cadd None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:38.135192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bc47a-8467-499d-8c36-83d6d469cadd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:38.135357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bc47a-8467-499d-8c36-83d6d469cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:38.198221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:38.201597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3a5bc47a-8467-499d-8c36-83d6d469cadd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:38.203375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3a5bc47a-8467-499d-8c36-83d6d469cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:38.297400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 662/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:38.577831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb0c4-7cd5-41dc-a4e6-d6032f7ba960 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:38.579435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-96dfb0c4-7cd5-41dc-a4e6-d6032f7ba960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:38.689489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfb0c4-7cd5-41dc-a4e6-d6032f7ba960 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:38.765194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896537fd-97f7-4886-aeb1-f0b7a5f78147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:38.765789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896537fd-97f7-4886-aeb1-f0b7a5f78147 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:38.766074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896537fd-97f7-4886-aeb1-f0b7a5f78147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:38.766357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896537fd-97f7-4886-aeb1-f0b7a5f78147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:38.767929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-896537fd-97f7-4886-aeb1-f0b7a5f78147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:38.794806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:38.875253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896537fd-97f7-4886-aeb1-f0b7a5f78147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:38.876605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896537fd-97f7-4886-aeb1-f0b7a5f78147 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:38.894651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 672/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:41.072044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9461b15-09ca-4953-bc3b-899ce624f53d None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:41.072526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9461b15-09ca-4953-bc3b-899ce624f53d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:41.072623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9461b15-09ca-4953-bc3b-899ce624f53d None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:41.073937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 663/1335] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:41.079694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34cd21-2f3c-4d11-9a8f-e9c51dbeee72 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:41.080096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34cd21-2f3c-4d11-9a8f-e9c51dbeee72 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:41.080245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34cd21-2f3c-4d11-9a8f-e9c51dbeee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:41.147935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5f34cd21-2f3c-4d11-9a8f-e9c51dbeee72 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:41.149131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5f34cd21-2f3c-4d11-9a8f-e9c51dbeee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:41.224286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:41.249132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 673/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:41.545763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9461b15-09ca-4953-bc3b-899ce624f53d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:41.547331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a9461b15-09ca-4953-bc3b-899ce624f53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:41.649059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9461b15-09ca-4953-bc3b-899ce624f53d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:41.679645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:41.726785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3d63d-c693-414c-95c8-ccb5da7a8014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:41.727380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3d63d-c693-414c-95c8-ccb5da7a8014 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:41.727656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3d63d-c693-414c-95c8-ccb5da7a8014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:41.727922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3d63d-c693-414c-95c8-ccb5da7a8014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:41.729494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-99c3d63d-c693-414c-95c8-ccb5da7a8014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:41.837735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3d63d-c693-414c-95c8-ccb5da7a8014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:41.839191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3d63d-c693-414c-95c8-ccb5da7a8014 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:41.857006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 664/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:44.419793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07676-89fa-4ff3-bdbd-98f1422bcf9c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:44.420356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07676-89fa-4ff3-bdbd-98f1422bcf9c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:44.420356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07676-89fa-4ff3-bdbd-98f1422bcf9c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:44.421625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 674/1338] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:44.426795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf33fd-9367-43e2-b2b3-3d1bfa9b2bce None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:44.427225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf33fd-9367-43e2-b2b3-3d1bfa9b2bce None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:44.427339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf33fd-9367-43e2-b2b3-3d1bfa9b2bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:44.491943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9caf33fd-9367-43e2-b2b3-3d1bfa9b2bce None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:44.493135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9caf33fd-9367-43e2-b2b3-3d1bfa9b2bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:44.501308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:44.588579 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 665/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:20:44.873142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07676-89fa-4ff3-bdbd-98f1422bcf9c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:44.874710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6de07676-89fa-4ff3-bdbd-98f1422bcf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:44.977763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07676-89fa-4ff3-bdbd-98f1422bcf9c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:45.050579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767a1b3-65eb-4d85-9946-5794a8d7dadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:45.051184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a1b3-65eb-4d85-9946-5794a8d7dadd service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:45.051463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a1b3-65eb-4d85-9946-5794a8d7dadd service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:45.051733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a1b3-65eb-4d85-9946-5794a8d7dadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:45.053348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5767a1b3-65eb-4d85-9946-5794a8d7dadd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:45.089071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:45.161774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767a1b3-65eb-4d85-9946-5794a8d7dadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:45.163165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767a1b3-65eb-4d85-9946-5794a8d7dadd service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:45.181785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 675/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:49.322811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fe3a-f60c-4515-82f2-8dc911e15210 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:49.323335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fe3a-f60c-4515-82f2-8dc911e15210 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:49.323335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7fe3a-f60c-4515-82f2-8dc911e15210 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:49.325878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 666/1341] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:49.332615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50aa09-ca0b-4ff3-922c-65084217c8bf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:49.333072 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50aa09-ca0b-4ff3-922c-65084217c8bf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:49.333187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50aa09-ca0b-4ff3-922c-65084217c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:49.401402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1c50aa09-ca0b-4ff3-922c-65084217c8bf None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:49.403389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1c50aa09-ca0b-4ff3-922c-65084217c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:49.488067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:49.499926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 676/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:20:49.791273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7fe3a-f60c-4515-82f2-8dc911e15210 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:49.793319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4ba7fe3a-f60c-4515-82f2-8dc911e15210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:49.900765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7fe3a-f60c-4515-82f2-8dc911e15210 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:49.939991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:49.975623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ad87f-6115-48b6-8dc9-f211623a0011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:49.976228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ad87f-6115-48b6-8dc9-f211623a0011 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:49.976504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ad87f-6115-48b6-8dc9-f211623a0011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:49.976770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ad87f-6115-48b6-8dc9-f211623a0011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:49.978492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f04ad87f-6115-48b6-8dc9-f211623a0011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:50.097415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ad87f-6115-48b6-8dc9-f211623a0011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:50.098923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ad87f-6115-48b6-8dc9-f211623a0011 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:50.118171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 667/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:52.953390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81966-812c-43dd-9834-75742d6098a7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:52.953933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81966-812c-43dd-9834-75742d6098a7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:52.953933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81966-812c-43dd-9834-75742d6098a7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:52.955314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 677/1344] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:52.960371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e367c-c0a2-4ce5-90d3-3844cc13447d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:52.960836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e367c-c0a2-4ce5-90d3-3844cc13447d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:52.960945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e367c-c0a2-4ce5-90d3-3844cc13447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:53.028855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-196e367c-c0a2-4ce5-90d3-3844cc13447d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:53.030059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-196e367c-c0a2-4ce5-90d3-3844cc13447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:53.048809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:53.131801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 668/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:20:53.430172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81966-812c-43dd-9834-75742d6098a7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:53.431827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a9c81966-812c-43dd-9834-75742d6098a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:53.539784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81966-812c-43dd-9834-75742d6098a7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:53.612975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4330d-4a4c-4905-b480-9d7ef3b37c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:53.613515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4330d-4a4c-4905-b480-9d7ef3b37c89 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:53.613789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4330d-4a4c-4905-b480-9d7ef3b37c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:53.614069 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4330d-4a4c-4905-b480-9d7ef3b37c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:53.615653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ade4330d-4a4c-4905-b480-9d7ef3b37c89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:53.659972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:53.727660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4330d-4a4c-4905-b480-9d7ef3b37c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:53.729082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4330d-4a4c-4905-b480-9d7ef3b37c89 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:53.748922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 678/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:20:58.282304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd221c9-87f6-4d8c-8077-4ab50e7d3135 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:58.282814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd221c9-87f6-4d8c-8077-4ab50e7d3135 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:58.282949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd221c9-87f6-4d8c-8077-4ab50e7d3135 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:58.284169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 669/1347] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:20:58.289334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93f79-72d2-40c4-82ed-51d8dcd4c117 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:58.289715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93f79-72d2-40c4-82ed-51d8dcd4c117 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:58.289888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93f79-72d2-40c4-82ed-51d8dcd4c117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:58.366966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b8a93f79-72d2-40c4-82ed-51d8dcd4c117 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:20:58.368176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8a93f79-72d2-40c4-82ed-51d8dcd4c117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:58.466844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:58.469586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 679/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:20:58.759399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd221c9-87f6-4d8c-8077-4ab50e7d3135 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:20:58.761635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bfd221c9-87f6-4d8c-8077-4ab50e7d3135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:58.864574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd221c9-87f6-4d8c-8077-4ab50e7d3135 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:20:58.913282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:20:58.942215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb620e-e0f8-43b3-885b-e5cbf2751cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:20:58.944531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb620e-e0f8-43b3-885b-e5cbf2751cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:20:58.944818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb620e-e0f8-43b3-885b-e5cbf2751cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:20:58.945097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb620e-e0f8-43b3-885b-e5cbf2751cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:20:58.946744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-51cb620e-e0f8-43b3-885b-e5cbf2751cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:20:59.057419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb620e-e0f8-43b3-885b-e5cbf2751cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:20:59.059274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb620e-e0f8-43b3-885b-e5cbf2751cd9 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:20:59.077982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 670/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:04.060109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d88c7-221b-43e7-8005-bd70848e8f44 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:04.060597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d88c7-221b-43e7-8005-bd70848e8f44 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:04.060681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d88c7-221b-43e7-8005-bd70848e8f44 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:04.062425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 680/1350] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:04.068575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9720c6-383b-4c93-a54a-40ac9926eb00 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:04.068575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9720c6-383b-4c93-a54a-40ac9926eb00 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:04.069039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9720c6-383b-4c93-a54a-40ac9926eb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:04.220759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3a9720c6-383b-4c93-a54a-40ac9926eb00 None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:04.220759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3a9720c6-383b-4c93-a54a-40ac9926eb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:04.242743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:04.340299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 671/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:21:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:08.537726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63627-3b3f-4d99-8ac5-770b2ab1dac4 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:08.538649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63627-3b3f-4d99-8ac5-770b2ab1dac4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:08.539024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d63627-3b3f-4d99-8ac5-770b2ab1dac4 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:08.540550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 681/1352] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:08.546517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9add96-1162-4a30-80f2-3638ac96a4aa None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:08.547290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9add96-1162-4a30-80f2-3638ac96a4aa None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:08.547765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9add96-1162-4a30-80f2-3638ac96a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:08.633720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-6b9add96-1162-4a30-80f2-3638ac96a4aa None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:08.635088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6b9add96-1162-4a30-80f2-3638ac96a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:08.716203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:08.755614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 672/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:21:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:10.158816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf755-32bf-4b04-a897-d70a9ff4b0bc None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:10.159367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf755-32bf-4b04-a897-d70a9ff4b0bc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:10.159367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adf755-32bf-4b04-a897-d70a9ff4b0bc None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:10.160703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 682/1354] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:10.167284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd18f-4d03-4d84-a633-1bc82c9e166b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:10.167711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd18f-4d03-4d84-a633-1bc82c9e166b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:10.167851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd18f-4d03-4d84-a633-1bc82c9e166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:10.247289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d71bd18f-4d03-4d84-a633-1bc82c9e166b None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:10.248594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d71bd18f-4d03-4d84-a633-1bc82c9e166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:10.356914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 673/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:21:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:13.915149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d30230-2f85-4314-a740-ada273edcabf None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:13.916274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d30230-2f85-4314-a740-ada273edcabf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:13.916274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d30230-2f85-4314-a740-ada273edcabf None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:13.917705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 683/1356] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:13.923156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea148-5d53-4dd2-9b87-dbd076950223 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:13.923641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea148-5d53-4dd2-9b87-dbd076950223 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:13.923731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea148-5d53-4dd2-9b87-dbd076950223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:13.967361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:14.010971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-151ea148-5d53-4dd2-9b87-dbd076950223 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:14.012474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-151ea148-5d53-4dd2-9b87-dbd076950223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:14.118122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 674/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:14.426229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7038-b68d-4e34-bb2b-3de95ca3a93b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:14.427348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7038-b68d-4e34-bb2b-3de95ca3a93b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:14.428319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b7038-b68d-4e34-bb2b-3de95ca3a93b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:14.430584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 684/1358] 10.222.0.18 () {54 vars in 961 bytes} [Fri Sep 30 19:21:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:14.439249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d0b2-2b5e-430d-8c50-a2eb3d79c7e8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:14.439536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d0b2-2b5e-430d-8c50-a2eb3d79c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:14.439808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825d0b2-2b5e-430d-8c50-a2eb3d79c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:14.521907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9825d0b2-2b5e-430d-8c50-a2eb3d79c7e8 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:14.523114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9825d0b2-2b5e-430d-8c50-a2eb3d79c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:14.580326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:14.653404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 675/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Sep 30 19:21:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:14.661853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b7038-b68d-4e34-bb2b-3de95ca3a93b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:14.663469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-291b7038-b68d-4e34-bb2b-3de95ca3a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:14.825242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b7038-b68d-4e34-bb2b-3de95ca3a93b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:14.903222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:14.946332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5125028-9972-4936-8ddf-b82d45f477c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:14.947548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125028-9972-4936-8ddf-b82d45f477c3 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:14.947854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125028-9972-4936-8ddf-b82d45f477c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:14.948187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125028-9972-4936-8ddf-b82d45f477c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:14.949853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c5125028-9972-4936-8ddf-b82d45f477c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:15.058192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5125028-9972-4936-8ddf-b82d45f477c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:15.058192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5125028-9972-4936-8ddf-b82d45f477c3 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:15.078263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 685/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:21:17.556303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350716d2-2ec0-492c-bac1-5bf94243abdf None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:17.556962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350716d2-2ec0-492c-bac1-5bf94243abdf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:17.556962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350716d2-2ec0-492c-bac1-5bf94243abdf None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:17.558536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 676/1361] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:17.564370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e2ce-bf42-4dff-8060-51d03bbd2207 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:17.564370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e2ce-bf42-4dff-8060-51d03bbd2207 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:17.564370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e2ce-bf42-4dff-8060-51d03bbd2207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:17.637574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8a93e2ce-bf42-4dff-8060-51d03bbd2207 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:17.638937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8a93e2ce-bf42-4dff-8060-51d03bbd2207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:17.680090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:17.751638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 686/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:18.048238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350716d2-2ec0-492c-bac1-5bf94243abdf None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:18.050303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-350716d2-2ec0-492c-bac1-5bf94243abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:18.232189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350716d2-2ec0-492c-bac1-5bf94243abdf None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:18.245871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:18.372411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a2081-7d51-4ab7-b77c-566647a2da07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:18.373029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a2081-7d51-4ab7-b77c-566647a2da07 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:18.373312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a2081-7d51-4ab7-b77c-566647a2da07 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:18.373586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a2081-7d51-4ab7-b77c-566647a2da07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:18.375739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-547a2081-7d51-4ab7-b77c-566647a2da07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:18.469298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a2081-7d51-4ab7-b77c-566647a2da07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:18.470865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a2081-7d51-4ab7-b77c-566647a2da07 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:18.490284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 677/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:21.027548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738103-4e0c-4c26-a98d-ad3237e0244c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:21.027548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738103-4e0c-4c26-a98d-ad3237e0244c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:21.027548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c738103-4e0c-4c26-a98d-ad3237e0244c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:21.029736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 687/1364] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:21.035505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceea2-28b2-4a60-af16-82765549db2b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:21.035939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceea2-28b2-4a60-af16-82765549db2b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:21.036028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ceea2-28b2-4a60-af16-82765549db2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:21.063865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:21.108209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-097ceea2-28b2-4a60-af16-82765549db2b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:21.109673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-097ceea2-28b2-4a60-af16-82765549db2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:21.214880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 678/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:21.509936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25815-ee1b-43aa-8bc9-d9c4a887aa90 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:21.510357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25815-ee1b-43aa-8bc9-d9c4a887aa90 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:21.510725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25815-ee1b-43aa-8bc9-d9c4a887aa90 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:21.512266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 688/1366] 10.222.0.18 () {54 vars in 961 bytes} [Fri Sep 30 19:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:21.517830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8c35f-4511-4b8b-9b69-231ffbbd65f3 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:21.518273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8c35f-4511-4b8b-9b69-231ffbbd65f3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:21.518553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8c35f-4511-4b8b-9b69-231ffbbd65f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:21.599138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-79c8c35f-4511-4b8b-9b69-231ffbbd65f3 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:21.600350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-79c8c35f-4511-4b8b-9b69-231ffbbd65f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:21.638284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:21.725822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 679/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Sep 30 19:21:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:21.733636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a25815-ee1b-43aa-8bc9-d9c4a887aa90 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:21.735444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-37a25815-ee1b-43aa-8bc9-d9c4a887aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:21.895466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a25815-ee1b-43aa-8bc9-d9c4a887aa90 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:21.917562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:22.020538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788811af-c973-4a1b-9a12-7537088ca3ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:22.021149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788811af-c973-4a1b-9a12-7537088ca3ea service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:22.021434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788811af-c973-4a1b-9a12-7537088ca3ea service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:22.021708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788811af-c973-4a1b-9a12-7537088ca3ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:22.023360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-788811af-c973-4a1b-9a12-7537088ca3ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:22.128316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788811af-c973-4a1b-9a12-7537088ca3ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:22.129966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788811af-c973-4a1b-9a12-7537088ca3ea service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:22.150688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 689/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:22.234803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d61f-178e-4ac4-b19f-9e505bbb4dcf None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:22.235346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d61f-178e-4ac4-b19f-9e505bbb4dcf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:22.235346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d61f-178e-4ac4-b19f-9e505bbb4dcf None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:22.236847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 680/1369] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:22.244969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed810-2dae-4351-a5ff-fc6e2aa67b82 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:22.245342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed810-2dae-4351-a5ff-fc6e2aa67b82 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:22.245709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ed810-2dae-4351-a5ff-fc6e2aa67b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:22.288028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:22.334878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d72ed810-2dae-4351-a5ff-fc6e2aa67b82 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:22.336368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d72ed810-2dae-4351-a5ff-fc6e2aa67b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:22.463628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 690/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:22.808144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbac31-7f8d-4aba-afcd-ccec66ac3843 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:22.808144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbac31-7f8d-4aba-afcd-ccec66ac3843 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:22.808144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbac31-7f8d-4aba-afcd-ccec66ac3843 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:22.810936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 681/1371] 10.222.0.18 () {54 vars in 963 bytes} [Fri Sep 30 19:21:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:22.813758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253eac-d89e-4f53-b931-b600fcd90766 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:22.814074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253eac-d89e-4f53-b931-b600fcd90766 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:22.814351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253eac-d89e-4f53-b931-b600fcd90766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:22.898853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0c253eac-d89e-4f53-b931-b600fcd90766 None None] MFA Rules not processed for user `d267807215f54e2ea4c91383b178ee25`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:22.900234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0c253eac-d89e-4f53-b931-b600fcd90766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:22.956047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:22.988790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 691/1372] 10.222.0.18 () {58 vars in 1060 bytes} [Fri Sep 30 19:21:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:22.996449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbac31-7f8d-4aba-afcd-ccec66ac3843 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:22.997942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-79fbac31-7f8d-4aba-afcd-ccec66ac3843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:23.116550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbac31-7f8d-4aba-afcd-ccec66ac3843 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:23.166339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:23.207381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54e883-4c85-4ce8-becb-fdd345516c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:23.207991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e883-4c85-4ce8-becb-fdd345516c5a service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:23.208267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e883-4c85-4ce8-becb-fdd345516c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:23.208533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54e883-4c85-4ce8-becb-fdd345516c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:23.210126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8d54e883-4c85-4ce8-becb-fdd345516c5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:23.348784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54e883-4c85-4ce8-becb-fdd345516c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:23.350921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54e883-4c85-4ce8-becb-fdd345516c5a service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:23.382781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 682/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:24.439619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862460d-b806-4392-912b-5ef2bb0d2271 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:24.440204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862460d-b806-4392-912b-5ef2bb0d2271 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:24.440204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862460d-b806-4392-912b-5ef2bb0d2271 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:24.441513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 692/1374] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:24.447232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16ada-3a60-4c6a-884d-e692fc0e5ab7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:24.447664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16ada-3a60-4c6a-884d-e692fc0e5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:24.447780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e16ada-3a60-4c6a-884d-e692fc0e5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:24.514429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c4e16ada-3a60-4c6a-884d-e692fc0e5ab7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:24.515630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c4e16ada-3a60-4c6a-884d-e692fc0e5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:24.535795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:24.612501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 683/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:21:24.911358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862460d-b806-4392-912b-5ef2bb0d2271 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:24.912906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0862460d-b806-4392-912b-5ef2bb0d2271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:25.073886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862460d-b806-4392-912b-5ef2bb0d2271 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:25.130658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:25.195116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c89cf2-8ff4-4694-92b1-0ae54602d64c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:25.196247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89cf2-8ff4-4694-92b1-0ae54602d64c service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:25.196702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89cf2-8ff4-4694-92b1-0ae54602d64c service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:25.197013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89cf2-8ff4-4694-92b1-0ae54602d64c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:25.198621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b0c89cf2-8ff4-4694-92b1-0ae54602d64c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:25.298137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c89cf2-8ff4-4694-92b1-0ae54602d64c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:25.302176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c89cf2-8ff4-4694-92b1-0ae54602d64c service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:25.327302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 693/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:27.589930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce68924-51ab-4a33-967e-5c24bc3fabdb None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:27.590487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce68924-51ab-4a33-967e-5c24bc3fabdb None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:27.590797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce68924-51ab-4a33-967e-5c24bc3fabdb None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:27.592387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 684/1377] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:27.597415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841607e7-1143-41fd-ab4c-55c18bcb71dd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:27.597826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841607e7-1143-41fd-ab4c-55c18bcb71dd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:27.598001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841607e7-1143-41fd-ab4c-55c18bcb71dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:27.670519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-841607e7-1143-41fd-ab4c-55c18bcb71dd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:27.671633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-841607e7-1143-41fd-ab4c-55c18bcb71dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:27.679032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:27.782281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 694/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:28.072624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce68924-51ab-4a33-967e-5c24bc3fabdb None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:28.074262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8ce68924-51ab-4a33-967e-5c24bc3fabdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:28.229635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce68924-51ab-4a33-967e-5c24bc3fabdb None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:28.233834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:28.348523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb223d1-281a-4644-a35b-b15c7e4ea053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:28.349426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb223d1-281a-4644-a35b-b15c7e4ea053 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:28.349818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb223d1-281a-4644-a35b-b15c7e4ea053 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:28.350211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb223d1-281a-4644-a35b-b15c7e4ea053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:28.352385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0bb223d1-281a-4644-a35b-b15c7e4ea053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:28.447469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb223d1-281a-4644-a35b-b15c7e4ea053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:28.449207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb223d1-281a-4644-a35b-b15c7e4ea053 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:28.469130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 685/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:30.695105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f030f1-9c48-4be5-8efe-fa04e013e9fe None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:30.695690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f030f1-9c48-4be5-8efe-fa04e013e9fe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:30.695930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f030f1-9c48-4be5-8efe-fa04e013e9fe None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:30.697509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 695/1380] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:30.702612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bb60-3a88-47ef-89ed-62ce2425bfc6 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:30.703036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bb60-3a88-47ef-89ed-62ce2425bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:30.703155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4bb60-3a88-47ef-89ed-62ce2425bfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:30.716001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:30.777495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e6c4bb60-3a88-47ef-89ed-62ce2425bfc6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:30.778819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e6c4bb60-3a88-47ef-89ed-62ce2425bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:30.931409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 686/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:31.216147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f030f1-9c48-4be5-8efe-fa04e013e9fe None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:31.217665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a9f030f1-9c48-4be5-8efe-fa04e013e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:31.364088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:31.376729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f030f1-9c48-4be5-8efe-fa04e013e9fe None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:31.498471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a873673-d55d-4e5b-b343-d256964ed9d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:31.499029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873673-d55d-4e5b-b343-d256964ed9d6 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:31.499319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873673-d55d-4e5b-b343-d256964ed9d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:31.499604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873673-d55d-4e5b-b343-d256964ed9d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:31.501279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1a873673-d55d-4e5b-b343-d256964ed9d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:31.595993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a873673-d55d-4e5b-b343-d256964ed9d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:31.597656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a873673-d55d-4e5b-b343-d256964ed9d6 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:31.609211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:31.619101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 696/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:33.905928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564ec8-7365-4d17-9639-1e47c7b0b5a4 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:33.906536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564ec8-7365-4d17-9639-1e47c7b0b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:33.906640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564ec8-7365-4d17-9639-1e47c7b0b5a4 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:33.908531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 687/1383] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:33.914453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e7d1b-09e5-425b-b85f-8bd2e2f91b7b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:33.914919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e7d1b-09e5-425b-b85f-8bd2e2f91b7b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:33.915168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e7d1b-09e5-425b-b85f-8bd2e2f91b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:33.993879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c38e7d1b-09e5-425b-b85f-8bd2e2f91b7b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:33.995517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c38e7d1b-09e5-425b-b85f-8bd2e2f91b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:34.106104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 697/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:34.395190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564ec8-7365-4d17-9639-1e47c7b0b5a4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:34.396704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-53564ec8-7365-4d17-9639-1e47c7b0b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:34.496676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:34.558484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564ec8-7365-4d17-9639-1e47c7b0b5a4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:34.675931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2193d3-4e73-4551-adf1-62ab221a73be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:34.676510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2193d3-4e73-4551-adf1-62ab221a73be service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:34.676736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2193d3-4e73-4551-adf1-62ab221a73be service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:34.677008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2193d3-4e73-4551-adf1-62ab221a73be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:34.678640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6e2193d3-4e73-4551-adf1-62ab221a73be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:34.735913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:34.784906 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2193d3-4e73-4551-adf1-62ab221a73be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:34.786551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2193d3-4e73-4551-adf1-62ab221a73be service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:34.815053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 688/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:21:37.140254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8245602-e263-4589-bdd4-4d3bbc6f17b4 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:37.140784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8245602-e263-4589-bdd4-4d3bbc6f17b4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:37.140784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8245602-e263-4589-bdd4-4d3bbc6f17b4 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:37.142183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 698/1386] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:37.147417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98bbfd-6ba7-4f5d-9058-ce0368c52441 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:37.147867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98bbfd-6ba7-4f5d-9058-ce0368c52441 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:37.148578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98bbfd-6ba7-4f5d-9058-ce0368c52441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:37.215451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1a98bbfd-6ba7-4f5d-9058-ce0368c52441 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:37.216644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1a98bbfd-6ba7-4f5d-9058-ce0368c52441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:37.314877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 689/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:37.608058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8245602-e263-4589-bdd4-4d3bbc6f17b4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:37.609813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e8245602-e263-4589-bdd4-4d3bbc6f17b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:37.687542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:37.757966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8245602-e263-4589-bdd4-4d3bbc6f17b4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:37.874244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b216056-bb8e-49ed-b82e-a786552e4383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:37.874769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b216056-bb8e-49ed-b82e-a786552e4383 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:37.875051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b216056-bb8e-49ed-b82e-a786552e4383 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:37.875318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b216056-bb8e-49ed-b82e-a786552e4383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:37.876900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b216056-bb8e-49ed-b82e-a786552e4383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:37.916635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:37.967810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b216056-bb8e-49ed-b82e-a786552e4383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:37.969441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b216056-bb8e-49ed-b82e-a786552e4383 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:37.988795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 699/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:38.753316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8d67-cbf8-44bb-86b6-2ff705373c1e None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:38.753856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8d67-cbf8-44bb-86b6-2ff705373c1e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:38.753856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a8d67-cbf8-44bb-86b6-2ff705373c1e None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:38.755283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 690/1389] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:38.761319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aab3a-cdaf-4250-aa4f-332ea2482535 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:38.761736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aab3a-cdaf-4250-aa4f-332ea2482535 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:38.761916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aab3a-cdaf-4250-aa4f-332ea2482535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:38.829920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-252aab3a-cdaf-4250-aa4f-332ea2482535 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:38.831182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-252aab3a-cdaf-4250-aa4f-332ea2482535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:38.934396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 700/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:39.241497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6850-f00c-4aca-9c18-d0ce2157dbb0 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:39.241782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6850-f00c-4aca-9c18-d0ce2157dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:39.242085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6850-f00c-4aca-9c18-d0ce2157dbb0 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:39.243397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 691/1391] 10.222.0.18 () {54 vars in 962 bytes} [Fri Sep 30 19:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:39.249078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738665-0f8a-4410-b180-6d2ee284da9d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:39.249374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738665-0f8a-4410-b180-6d2ee284da9d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:39.249654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738665-0f8a-4410-b180-6d2ee284da9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:39.266003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:39.328541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d5738665-0f8a-4410-b180-6d2ee284da9d None None] MFA Rules not processed for user `9f5190ae783a4c89b51797729aaaa6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:39.329651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d5738665-0f8a-4410-b180-6d2ee284da9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:39.407233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 701/1392] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Sep 30 19:21:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:39.416537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6850-f00c-4aca-9c18-d0ce2157dbb0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:39.418209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8eec6850-f00c-4aca-9c18-d0ce2157dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:39.449492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:39.521964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6850-f00c-4aca-9c18-d0ce2157dbb0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:39.594567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b4f6-36c0-4875-8c60-614b6ff089a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5190ae783a4c89b51797729aaaa6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:39.595095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b4f6-36c0-4875-8c60-614b6ff089a4 service glance] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:39.595370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b4f6-36c0-4875-8c60-614b6ff089a4 service glance] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:39.595636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b4f6-36c0-4875-8c60-614b6ff089a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:39.597276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8745b4f6-36c0-4875-8c60-614b6ff089a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:39.677853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:39.711366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745b4f6-36c0-4875-8c60-614b6ff089a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:39.712995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745b4f6-36c0-4875-8c60-614b6ff089a4 service glance] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:39.732280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 692/1393] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:40.237772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535579-3808-4372-9a92-70769e46c6dc None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:40.238358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535579-3808-4372-9a92-70769e46c6dc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:40.238358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35535579-3808-4372-9a92-70769e46c6dc None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:40.239698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 702/1394] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:40.245076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733bfd-11fa-4451-b615-458493490989 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:40.245525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733bfd-11fa-4451-b615-458493490989 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:40.245658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34733bfd-11fa-4451-b615-458493490989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:40.318636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-34733bfd-11fa-4451-b615-458493490989 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:40.320480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-34733bfd-11fa-4451-b615-458493490989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:40.429544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 693/1395] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:40.505232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:40.505523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:40.505804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:40.579904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:40.581116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:40.636870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:40.677229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 703/1396] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:40.718946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0e61-7a74-4346-a31e-4173653ed6f5 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:40.719237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0e61-7a74-4346-a31e-4173653ed6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:40.719518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0e61-7a74-4346-a31e-4173653ed6f5 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:40.719948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:40.720861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 694/1397] 10.222.0.18 () {54 vars in 943 bytes} [Fri Sep 30 19:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:40.721279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:40.727605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b872-18c4-4eb5-acd0-22b97b4a58c6 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:40.727953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b872-18c4-4eb5-acd0-22b97b4a58c6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:40.728228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b872-18c4-4eb5-acd0-22b97b4a58c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:40.776669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:40.808935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c2e1b872-18c4-4eb5-acd0-22b97b4a58c6 None None] MFA Rules not processed for user `2975430fac884ff89b88b9fe1b76cb30`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:40.810187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c2e1b872-18c4-4eb5-acd0-22b97b4a58c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:40.838891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ebced-9c0d-438b-b52a-654e6cc43189 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:40.919272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 695/1398] 10.222.0.18 () {58 vars in 1040 bytes} [Fri Sep 30 19:21:40 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:21:40.919664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:40.928888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b872-18c4-4eb5-acd0-22b97b4a58c6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:40.938991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b872-18c4-4eb5-acd0-22b97b4a58c6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:40.955862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3a43-a73f-48be-a7dc-35f7898ff5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:40.956476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3a43-a73f-48be-a7dc-35f7898ff5b4 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:40.956757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3a43-a73f-48be-a7dc-35f7898ff5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:40.957030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3a43-a73f-48be-a7dc-35f7898ff5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:40.958648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-389f3a43-a73f-48be-a7dc-35f7898ff5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:41.026442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:41.047617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36932e-a9e9-41a5-9d54-c089544fb1e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:41.048350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36932e-a9e9-41a5-9d54-c089544fb1e8 service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:41.048636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36932e-a9e9-41a5-9d54-c089544fb1e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:41.048903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36932e-a9e9-41a5-9d54-c089544fb1e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:41.050625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cb36932e-a9e9-41a5-9d54-c089544fb1e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:41.061929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3a43-a73f-48be-a7dc-35f7898ff5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:41.063657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3a43-a73f-48be-a7dc-35f7898ff5b4 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:41.083028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 704/1399] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:21:41.138074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36932e-a9e9-41a5-9d54-c089544fb1e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:41.139909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36932e-a9e9-41a5-9d54-c089544fb1e8 service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:41.151994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 696/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:21:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 19:21:43.329801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c8039-5e01-4048-9152-a182866bb8f1 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:43.330356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c8039-5e01-4048-9152-a182866bb8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:43.330356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c8039-5e01-4048-9152-a182866bb8f1 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:43.331789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 705/1401] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:43.340236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e521e31-f12a-45c0-a5f9-1a494716a011 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:43.340236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e521e31-f12a-45c0-a5f9-1a494716a011 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:43.340236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e521e31-f12a-45c0-a5f9-1a494716a011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:43.421132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4e521e31-f12a-45c0-a5f9-1a494716a011 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:43.422461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4e521e31-f12a-45c0-a5f9-1a494716a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:43.499839 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:43.534340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 697/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:43.837865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c8039-5e01-4048-9152-a182866bb8f1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:43.839545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ae3c8039-5e01-4048-9152-a182866bb8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:43.938551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:44.007257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c8039-5e01-4048-9152-a182866bb8f1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:44.136937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d931f-c46e-4c0e-b8e7-f440a7751009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:44.137463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d931f-c46e-4c0e-b8e7-f440a7751009 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:44.137739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d931f-c46e-4c0e-b8e7-f440a7751009 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:44.138007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d931f-c46e-4c0e-b8e7-f440a7751009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:44.139873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b17d931f-c46e-4c0e-b8e7-f440a7751009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:44.203689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:44.244065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d931f-c46e-4c0e-b8e7-f440a7751009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:44.245788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d931f-c46e-4c0e-b8e7-f440a7751009 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:44.270090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 706/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:21:46.507146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612798-098d-4e57-abff-28f16df661cd None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:46.507721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612798-098d-4e57-abff-28f16df661cd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:46.507721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d612798-098d-4e57-abff-28f16df661cd None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:46.509014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 698/1404] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:46.514574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174151-4611-4efb-b146-aa177d00ff9a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:46.515075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174151-4611-4efb-b146-aa177d00ff9a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:46.515075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174151-4611-4efb-b146-aa177d00ff9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:46.592107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-50174151-4611-4efb-b146-aa177d00ff9a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:46.593421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-50174151-4611-4efb-b146-aa177d00ff9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:46.704317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 707/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:46.996756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d612798-098d-4e57-abff-28f16df661cd None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:46.998298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2d612798-098d-4e57-abff-28f16df661cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:47.165781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d612798-098d-4e57-abff-28f16df661cd None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:47.225483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:47.296082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121488f1-69ce-4756-a111-7091d7876311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:47.296611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121488f1-69ce-4756-a111-7091d7876311 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:47.296901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121488f1-69ce-4756-a111-7091d7876311 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:47.297165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121488f1-69ce-4756-a111-7091d7876311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:47.298794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-121488f1-69ce-4756-a111-7091d7876311 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:47.405104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121488f1-69ce-4756-a111-7091d7876311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:47.406859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121488f1-69ce-4756-a111-7091d7876311 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:47.425689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 699/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:49.699073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435be64-6a1d-4d49-bc67-02a0b9b0a9a1 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:49.699604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435be64-6a1d-4d49-bc67-02a0b9b0a9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:49.699604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435be64-6a1d-4d49-bc67-02a0b9b0a9a1 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:49.700879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 708/1407] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:21:49.706201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8937afc-0a63-40c8-ab19-e3c816602ec3 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:49.706652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8937afc-0a63-40c8-ab19-e3c816602ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:49.706746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8937afc-0a63-40c8-ab19-e3c816602ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:49.778260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a8937afc-0a63-40c8-ab19-e3c816602ec3 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:21:49.779472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a8937afc-0a63-40c8-ab19-e3c816602ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:49.793231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:49.883548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 700/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:21:50.171440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435be64-6a1d-4d49-bc67-02a0b9b0a9a1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:21:50.172934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3435be64-6a1d-4d49-bc67-02a0b9b0a9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:50.213261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:50.345400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435be64-6a1d-4d49-bc67-02a0b9b0a9a1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:21:50.466276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:21:50.473343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af116e1-86ed-4b3a-8e90-4756d460e714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:21:50.473960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af116e1-86ed-4b3a-8e90-4756d460e714 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:21:50.474274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af116e1-86ed-4b3a-8e90-4756d460e714 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:21:50.474551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af116e1-86ed-4b3a-8e90-4756d460e714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:21:50.476321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9af116e1-86ed-4b3a-8e90-4756d460e714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:21:50.579859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af116e1-86ed-4b3a-8e90-4756d460e714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:21:50.581474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af116e1-86ed-4b3a-8e90-4756d460e714 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:21:50.601518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 709/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:21:59.882038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=38 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:00.598660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=48 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:03.697094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0b5f-76c8-4dfd-9b7d-aa42ce84235c None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:03.697647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0b5f-76c8-4dfd-9b7d-aa42ce84235c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:03.697647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0b5f-76c8-4dfd-9b7d-aa42ce84235c None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:03.698917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 701/1410] 10.222.0.18 () {54 vars in 918 bytes} [Fri Sep 30 19:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:03.703916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abe4c9-8f82-45d6-b965-cb8048baa7ee None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:03.704366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abe4c9-8f82-45d6-b965-cb8048baa7ee None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:03.704479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abe4c9-8f82-45d6-b965-cb8048baa7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:03.781438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a8abe4c9-8f82-45d6-b965-cb8048baa7ee None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:03.782728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a8abe4c9-8f82-45d6-b965-cb8048baa7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:03.887351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 710/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 30 19:22:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:03.902073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480407db-9b12-47fc-8930-f9880312267e None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:03.902393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480407db-9b12-47fc-8930-f9880312267e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:03.902668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480407db-9b12-47fc-8930-f9880312267e None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:03.903979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 702/1412] 10.222.0.18 () {54 vars in 918 bytes} [Fri Sep 30 19:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:03.908946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5336-aa41-457a-b8c1-3d9873796e41 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:03.909261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5336-aa41-457a-b8c1-3d9873796e41 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:03.909536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5336-aa41-457a-b8c1-3d9873796e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:03.983141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:03.986392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e98e5336-aa41-457a-b8c1-3d9873796e41 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:03.988160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e98e5336-aa41-457a-b8c1-3d9873796e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:04.105404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 711/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Fri Sep 30 19:22:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:06.683350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4c96-79a2-42ab-b510-9b85b30bcf6d None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:06.683913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4c96-79a2-42ab-b510-9b85b30bcf6d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:06.683913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4c96-79a2-42ab-b510-9b85b30bcf6d None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:06.685201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:06.690435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1084b-d779-4df7-83bf-e3785c0f8b1d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:06.690859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1084b-d779-4df7-83bf-e3785c0f8b1d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:06.691015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1084b-d779-4df7-83bf-e3785c0f8b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:06.760305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-95b1084b-d779-4df7-83bf-e3785c0f8b1d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:06.761546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-95b1084b-d779-4df7-83bf-e3785c0f8b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:06.818899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:06.861448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:07.148487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4c96-79a2-42ab-b510-9b85b30bcf6d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:07.150121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bc7c4c96-79a2-42ab-b510-9b85b30bcf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:07.295333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4c96-79a2-42ab-b510-9b85b30bcf6d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:07.367890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:07.408630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd56d-bf8c-43a6-b7f7-2ae93008fd11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:07.409235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd56d-bf8c-43a6-b7f7-2ae93008fd11 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:07.409510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd56d-bf8c-43a6-b7f7-2ae93008fd11 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:07.409782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd56d-bf8c-43a6-b7f7-2ae93008fd11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:07.411483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a5ffd56d-bf8c-43a6-b7f7-2ae93008fd11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:07.501050 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffd56d-bf8c-43a6-b7f7-2ae93008fd11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:07.502683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffd56d-bf8c-43a6-b7f7-2ae93008fd11 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:07.520976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 704/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:08.658697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310f51-234f-4302-8bc7-a1c8325a5173 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:08.659271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310f51-234f-4302-8bc7-a1c8325a5173 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:08.659271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310f51-234f-4302-8bc7-a1c8325a5173 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:08.660604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:08.667632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc9f0-4395-4ea5-87e4-803fccbcca8c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:08.668074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc9f0-4395-4ea5-87e4-803fccbcca8c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:08.668177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffc9f0-4395-4ea5-87e4-803fccbcca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:08.745458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-aeffc9f0-4395-4ea5-87e4-803fccbcca8c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:08.746679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-aeffc9f0-4395-4ea5-87e4-803fccbcca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:08.775128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:08.844857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:22:08.998920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310f51-234f-4302-8bc7-a1c8325a5173 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:09.000344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4d310f51-234f-4302-8bc7-a1c8325a5173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:09.146976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310f51-234f-4302-8bc7-a1c8325a5173 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:09.187127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:09.260725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefec5d-0afb-4c7b-aab1-458522902ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:09.261254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefec5d-0afb-4c7b-aab1-458522902ebf service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:09.261534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefec5d-0afb-4c7b-aab1-458522902ebf service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:09.261803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefec5d-0afb-4c7b-aab1-458522902ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:09.263436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cdefec5d-0afb-4c7b-aab1-458522902ebf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:09.352930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefec5d-0afb-4c7b-aab1-458522902ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:09.354539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefec5d-0afb-4c7b-aab1-458522902ebf service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:09.372674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 714/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:10.496032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96f27-cb77-4682-ad2c-9e20ab7f0b97 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:10.496558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96f27-cb77-4682-ad2c-9e20ab7f0b97 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:10.496558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96f27-cb77-4682-ad2c-9e20ab7f0b97 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:10.497846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:10.503881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a6f0-48a6-4fdc-99d0-8e7710751c82 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:10.504360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a6f0-48a6-4fdc-99d0-8e7710751c82 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:10.504587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a6f0-48a6-4fdc-99d0-8e7710751c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:10.560368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:10.582731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5e22a6f0-48a6-4fdc-99d0-8e7710751c82 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:10.584000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5e22a6f0-48a6-4fdc-99d0-8e7710751c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:10.681853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:10.833255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf96f27-cb77-4682-ad2c-9e20ab7f0b97 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:10.835025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ccf96f27-cb77-4682-ad2c-9e20ab7f0b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:10.979182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf96f27-cb77-4682-ad2c-9e20ab7f0b97 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:10.991677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:11.099008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474da0b8-5b27-41b9-969d-dc793166a973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:11.099537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da0b8-5b27-41b9-969d-dc793166a973 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:11.099818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da0b8-5b27-41b9-969d-dc793166a973 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:11.100088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474da0b8-5b27-41b9-969d-dc793166a973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:11.101709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-474da0b8-5b27-41b9-969d-dc793166a973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:11.191286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474da0b8-5b27-41b9-969d-dc793166a973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:11.193664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474da0b8-5b27-41b9-969d-dc793166a973 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:11.211550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 707/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:12.317015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253360a7-b710-49ee-9636-a314ced51aa7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:12.317549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253360a7-b710-49ee-9636-a314ced51aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:12.317549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253360a7-b710-49ee-9636-a314ced51aa7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:12.318866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:12.324995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251064f8-7d89-4cc6-b80d-ae5de0610696 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:12.325439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251064f8-7d89-4cc6-b80d-ae5de0610696 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:12.325560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251064f8-7d89-4cc6-b80d-ae5de0610696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:12.345192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:12.401796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-251064f8-7d89-4cc6-b80d-ae5de0610696 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:12.403032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-251064f8-7d89-4cc6-b80d-ae5de0610696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:12.499258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:12.650786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253360a7-b710-49ee-9636-a314ced51aa7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:12.652208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-253360a7-b710-49ee-9636-a314ced51aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:12.763512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:12.799745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253360a7-b710-49ee-9636-a314ced51aa7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:12.912697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388cadb-a3ee-4a41-9f72-117ebb2b7f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:12.913227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388cadb-a3ee-4a41-9f72-117ebb2b7f79 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:12.913508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388cadb-a3ee-4a41-9f72-117ebb2b7f79 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:12.913782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388cadb-a3ee-4a41-9f72-117ebb2b7f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:12.915404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4388cadb-a3ee-4a41-9f72-117ebb2b7f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:12.992298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:13.006154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388cadb-a3ee-4a41-9f72-117ebb2b7f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:13.007753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388cadb-a3ee-4a41-9f72-117ebb2b7f79 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:13.025963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 717/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:14.150631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897abc19-2c57-4be0-9f9a-0060cd0ff965 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:14.151195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897abc19-2c57-4be0-9f9a-0060cd0ff965 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:14.151195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897abc19-2c57-4be0-9f9a-0060cd0ff965 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:14.152513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:14.158696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d177-900c-4c5c-9d36-80adc7a934fe None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:14.159146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d177-900c-4c5c-9d36-80adc7a934fe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:14.159264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d177-900c-4c5c-9d36-80adc7a934fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:14.244151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-49a0d177-900c-4c5c-9d36-80adc7a934fe None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:14.245445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-49a0d177-900c-4c5c-9d36-80adc7a934fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:14.342544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:22:14.493654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897abc19-2c57-4be0-9f9a-0060cd0ff965 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:14.495259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-897abc19-2c57-4be0-9f9a-0060cd0ff965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:14.588164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:14.651287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897abc19-2c57-4be0-9f9a-0060cd0ff965 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:14.766486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166acce-f220-438c-9180-d3c1be4c8271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:14.767093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166acce-f220-438c-9180-d3c1be4c8271 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:14.767374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166acce-f220-438c-9180-d3c1be4c8271 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:14.767642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166acce-f220-438c-9180-d3c1be4c8271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:14.769227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0166acce-f220-438c-9180-d3c1be4c8271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:14.816793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:14.858440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166acce-f220-438c-9180-d3c1be4c8271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:14.860073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166acce-f220-438c-9180-d3c1be4c8271 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:14.878241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 710/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:15.961831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862047-5d6f-4657-989d-0a943da8a65b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:15.962475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862047-5d6f-4657-989d-0a943da8a65b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:15.962475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39862047-5d6f-4657-989d-0a943da8a65b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:15.963805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:15.970466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7992d6-43ee-4455-bc99-6088603e575c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:15.970969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7992d6-43ee-4455-bc99-6088603e575c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:15.971086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7992d6-43ee-4455-bc99-6088603e575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:16.054609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5d7992d6-43ee-4455-bc99-6088603e575c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:16.055858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5d7992d6-43ee-4455-bc99-6088603e575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:16.172772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:16.330180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862047-5d6f-4657-989d-0a943da8a65b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:16.331690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-39862047-5d6f-4657-989d-0a943da8a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:16.389507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:16.511003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39862047-5d6f-4657-989d-0a943da8a65b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:16.649904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374105c-5a34-46c7-80c4-91c6e24ca3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:16.650539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374105c-5a34-46c7-80c4-91c6e24ca3de service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:16.650821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374105c-5a34-46c7-80c4-91c6e24ca3de service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:16.651094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374105c-5a34-46c7-80c4-91c6e24ca3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:16.652715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4374105c-5a34-46c7-80c4-91c6e24ca3de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:16.663861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:16.872515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374105c-5a34-46c7-80c4-91c6e24ca3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:16.874086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374105c-5a34-46c7-80c4-91c6e24ca3de service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:16.891531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 720/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:17.942221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37434-2d63-4bff-9e76-4740313d6f49 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:17.942803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37434-2d63-4bff-9e76-4740313d6f49 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:17.942906 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f37434-2d63-4bff-9e76-4740313d6f49 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:17.944175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:17.950518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadf355-2983-476f-bb81-7d254ed25fcf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:17.950958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadf355-2983-476f-bb81-7d254ed25fcf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:17.951092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadf355-2983-476f-bb81-7d254ed25fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:18.025641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4aadf355-2983-476f-bb81-7d254ed25fcf None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:18.026854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4aadf355-2983-476f-bb81-7d254ed25fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:18.096558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:18.127099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:18.288101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37434-2d63-4bff-9e76-4740313d6f49 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:18.289598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-56f37434-2d63-4bff-9e76-4740313d6f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:18.307376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:18.437716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f37434-2d63-4bff-9e76-4740313d6f49 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:18.524684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:18.551713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e20d6-e166-4b8b-91d3-9fe2a31fdaf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:18.552306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e20d6-e166-4b8b-91d3-9fe2a31fdaf8 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:18.552576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e20d6-e166-4b8b-91d3-9fe2a31fdaf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:18.552838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e20d6-e166-4b8b-91d3-9fe2a31fdaf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:18.554722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-744e20d6-e166-4b8b-91d3-9fe2a31fdaf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:18.644375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e20d6-e166-4b8b-91d3-9fe2a31fdaf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:18.646089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e20d6-e166-4b8b-91d3-9fe2a31fdaf8 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:18.664543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 713/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:19.712510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea651ed-0065-48ef-bceb-60d308b14f50 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:19.713026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea651ed-0065-48ef-bceb-60d308b14f50 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:19.713026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea651ed-0065-48ef-bceb-60d308b14f50 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:19.714363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:19.720892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054fe6e-cc24-4725-944b-21e8a9449f95 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:19.721359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054fe6e-cc24-4725-944b-21e8a9449f95 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:19.721466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054fe6e-cc24-4725-944b-21e8a9449f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:19.798199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3054fe6e-cc24-4725-944b-21e8a9449f95 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:19.799518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3054fe6e-cc24-4725-944b-21e8a9449f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:19.843815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:19.899144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:20.048761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea651ed-0065-48ef-bceb-60d308b14f50 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:20.050344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cea651ed-0065-48ef-bceb-60d308b14f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:20.196243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea651ed-0065-48ef-bceb-60d308b14f50 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:20.250192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:20.309655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3307419-3858-4b8a-aa42-b348c11d4b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:20.310216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307419-3858-4b8a-aa42-b348c11d4b71 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:20.310490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307419-3858-4b8a-aa42-b348c11d4b71 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:20.310755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307419-3858-4b8a-aa42-b348c11d4b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:20.312325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d3307419-3858-4b8a-aa42-b348c11d4b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:20.400407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3307419-3858-4b8a-aa42-b348c11d4b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:20.401976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3307419-3858-4b8a-aa42-b348c11d4b71 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:20.420570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 723/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:22:21.490957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5a66-06e6-483a-98a0-fc9569228694 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:21.491502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5a66-06e6-483a-98a0-fc9569228694 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:21.491502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5a66-06e6-483a-98a0-fc9569228694 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:21.492855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:21.499183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364db8bf-b4e7-48c7-b20d-018fe3ff29c4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:21.499598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364db8bf-b4e7-48c7-b20d-018fe3ff29c4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:21.499731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364db8bf-b4e7-48c7-b20d-018fe3ff29c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:21.576190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-364db8bf-b4e7-48c7-b20d-018fe3ff29c4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:21.577382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-364db8bf-b4e7-48c7-b20d-018fe3ff29c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:21.579458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:21.686847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:21.835495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5a66-06e6-483a-98a0-fc9569228694 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:21.837046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2a4c5a66-06e6-483a-98a0-fc9569228694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:21.989275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5a66-06e6-483a-98a0-fc9569228694 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:22.017321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:22.107868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac15c4f-ab68-4335-85f2-76a5b6067ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:22.108468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac15c4f-ab68-4335-85f2-76a5b6067ef8 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:22.108744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac15c4f-ab68-4335-85f2-76a5b6067ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:22.109012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac15c4f-ab68-4335-85f2-76a5b6067ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:22.110635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1ac15c4f-ab68-4335-85f2-76a5b6067ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:22.200716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac15c4f-ab68-4335-85f2-76a5b6067ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:22.202337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac15c4f-ab68-4335-85f2-76a5b6067ef8 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:22.220429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 716/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:24.784161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fab2a-9cee-4adf-b4ba-2a1dc1100b14 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:24.785331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fab2a-9cee-4adf-b4ba-2a1dc1100b14 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:24.785588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fab2a-9cee-4adf-b4ba-2a1dc1100b14 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:24.787521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:24.792984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7057a-5d92-4f47-8399-0c1ca1fd121b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:24.793430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7057a-5d92-4f47-8399-0c1ca1fd121b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:24.793534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7057a-5d92-4f47-8399-0c1ca1fd121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:24.834534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:24.861256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b9c7057a-5d92-4f47-8399-0c1ca1fd121b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:24.862518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b9c7057a-5d92-4f47-8399-0c1ca1fd121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:24.959450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:25.252431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fab2a-9cee-4adf-b4ba-2a1dc1100b14 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:25.254740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-098fab2a-9cee-4adf-b4ba-2a1dc1100b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:25.365888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fab2a-9cee-4adf-b4ba-2a1dc1100b14 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:25.399017 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:25.443107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ece09-76bf-41de-ab3e-6f7c69c7915c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:25.443717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ece09-76bf-41de-ab3e-6f7c69c7915c service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:25.443995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ece09-76bf-41de-ab3e-6f7c69c7915c service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:25.444270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ece09-76bf-41de-ab3e-6f7c69c7915c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:25.445880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7a5ece09-76bf-41de-ab3e-6f7c69c7915c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:25.556228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ece09-76bf-41de-ab3e-6f7c69c7915c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:25.557641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5ece09-76bf-41de-ab3e-6f7c69c7915c service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:25.575785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 726/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:27.903235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc26ff3-505e-460c-b0a4-980c5bdf7801 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:27.903836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc26ff3-505e-460c-b0a4-980c5bdf7801 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:27.903836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc26ff3-505e-460c-b0a4-980c5bdf7801 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:27.905116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:27.910502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c2d9-126b-4453-a332-97909031ec0a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:27.910935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c2d9-126b-4453-a332-97909031ec0a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:27.911049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016c2d9-126b-4453-a332-97909031ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:27.979933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f016c2d9-126b-4453-a332-97909031ec0a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:27.981421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f016c2d9-126b-4453-a332-97909031ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:27.994920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:28.080829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:22:28.360188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc26ff3-505e-460c-b0a4-980c5bdf7801 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:28.361720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5bc26ff3-505e-460c-b0a4-980c5bdf7801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:28.464888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc26ff3-505e-460c-b0a4-980c5bdf7801 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:28.478530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:28.540436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f54895-aeb0-4ceb-b3a1-46cdbbb714e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:28.541044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54895-aeb0-4ceb-b3a1-46cdbbb714e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:28.541325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54895-aeb0-4ceb-b3a1-46cdbbb714e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:28.541599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f54895-aeb0-4ceb-b3a1-46cdbbb714e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:28.543239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-92f54895-aeb0-4ceb-b3a1-46cdbbb714e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:28.651450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f54895-aeb0-4ceb-b3a1-46cdbbb714e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:28.652804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f54895-aeb0-4ceb-b3a1-46cdbbb714e4 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:28.674473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 719/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:31.220095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac7d02-4a2b-4c2e-9ce6-ceba3752c8ca None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:31.220663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac7d02-4a2b-4c2e-9ce6-ceba3752c8ca None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:31.220663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac7d02-4a2b-4c2e-9ce6-ceba3752c8ca None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:31.222274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:31.227751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02c96e-f2a1-426a-9c41-c908be3a9308 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:31.228216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02c96e-f2a1-426a-9c41-c908be3a9308 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:31.228352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02c96e-f2a1-426a-9c41-c908be3a9308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:31.277406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:31.295105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-da02c96e-f2a1-426a-9c41-c908be3a9308 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:31.296304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-da02c96e-f2a1-426a-9c41-c908be3a9308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:31.398227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:31.691726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac7d02-4a2b-4c2e-9ce6-ceba3752c8ca None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:31.693235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b7ac7d02-4a2b-4c2e-9ce6-ceba3752c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:31.796795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac7d02-4a2b-4c2e-9ce6-ceba3752c8ca None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:31.837124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:31.872243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b5ae4-41e0-4235-a823-766e2fb59843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:31.872848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5ae4-41e0-4235-a823-766e2fb59843 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:31.873128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5ae4-41e0-4235-a823-766e2fb59843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:31.873401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b5ae4-41e0-4235-a823-766e2fb59843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:31.875043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2f5b5ae4-41e0-4235-a823-766e2fb59843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:31.982988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b5ae4-41e0-4235-a823-766e2fb59843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:31.984316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b5ae4-41e0-4235-a823-766e2fb59843 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:32.002238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 729/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:22:34.299822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78463aef-b569-4f46-8896-5121626b91f5 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:34.300368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78463aef-b569-4f46-8896-5121626b91f5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:34.300368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78463aef-b569-4f46-8896-5121626b91f5 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:34.301764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:34.307550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d58a-89a5-4fac-b4ae-8d77db6a7fe6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:34.307947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d58a-89a5-4fac-b4ae-8d77db6a7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:34.308050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160d58a-89a5-4fac-b4ae-8d77db6a7fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:34.373817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2160d58a-89a5-4fac-b4ae-8d77db6a7fe6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:34.375032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2160d58a-89a5-4fac-b4ae-8d77db6a7fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:34.396140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:34.473579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:34.767481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78463aef-b569-4f46-8896-5121626b91f5 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:34.769765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-78463aef-b569-4f46-8896-5121626b91f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:34.871773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78463aef-b569-4f46-8896-5121626b91f5 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:34.892994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:34.946464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb83fc4-7e25-4ebc-beb5-23ae55c3fcf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:34.947064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb83fc4-7e25-4ebc-beb5-23ae55c3fcf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:34.947339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb83fc4-7e25-4ebc-beb5-23ae55c3fcf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:34.947601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb83fc4-7e25-4ebc-beb5-23ae55c3fcf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:34.949165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2eb83fc4-7e25-4ebc-beb5-23ae55c3fcf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:35.057376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb83fc4-7e25-4ebc-beb5-23ae55c3fcf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:35.058847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb83fc4-7e25-4ebc-beb5-23ae55c3fcf6 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:35.077509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 722/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:37.390353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3cf34-bdf1-43bb-8795-90b3450578be None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:37.390892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3cf34-bdf1-43bb-8795-90b3450578be None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:37.390892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3cf34-bdf1-43bb-8795-90b3450578be None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:37.392146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:37.397681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9043a-fa2b-4ba0-802b-c3103f31ebcc None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:37.398131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9043a-fa2b-4ba0-802b-c3103f31ebcc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:37.398263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9043a-fa2b-4ba0-802b-c3103f31ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:37.461975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:37.465318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-62b9043a-fa2b-4ba0-802b-c3103f31ebcc None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:37.466958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-62b9043a-fa2b-4ba0-802b-c3103f31ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:37.562776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:37.849999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3cf34-bdf1-43bb-8795-90b3450578be None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:37.851575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a2e3cf34-bdf1-43bb-8795-90b3450578be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:37.954557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3cf34-bdf1-43bb-8795-90b3450578be None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:38.004665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:38.029153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410dd09-0105-45e4-b9cb-26b6fd57cebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:38.029755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dd09-0105-45e4-b9cb-26b6fd57cebf service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:38.030034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dd09-0105-45e4-b9cb-26b6fd57cebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:38.030338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dd09-0105-45e4-b9cb-26b6fd57cebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:38.031937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b410dd09-0105-45e4-b9cb-26b6fd57cebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:38.142959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410dd09-0105-45e4-b9cb-26b6fd57cebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:38.144296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410dd09-0105-45e4-b9cb-26b6fd57cebf service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:38.162666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 732/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:40.405675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6521dd8-a312-4fc4-b330-ca5af845bb8b None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:40.406229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6521dd8-a312-4fc4-b330-ca5af845bb8b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:40.406229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6521dd8-a312-4fc4-b330-ca5af845bb8b None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:40.407573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:40.413527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369aabd-ba55-4b5c-9dc4-658d3e0bd2cd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:40.413967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369aabd-ba55-4b5c-9dc4-658d3e0bd2cd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:40.414111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369aabd-ba55-4b5c-9dc4-658d3e0bd2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:40.479579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a369aabd-ba55-4b5c-9dc4-658d3e0bd2cd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:40.481024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a369aabd-ba55-4b5c-9dc4-658d3e0bd2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:40.510799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:40.576845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:22:40.877205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6521dd8-a312-4fc4-b330-ca5af845bb8b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:40.878864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c6521dd8-a312-4fc4-b330-ca5af845bb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:40.984196 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6521dd8-a312-4fc4-b330-ca5af845bb8b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:41.013297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:41.058492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f05e7a-01c3-4ed9-bd2a-ab626499bfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:41.059099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f05e7a-01c3-4ed9-bd2a-ab626499bfad service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:41.059375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f05e7a-01c3-4ed9-bd2a-ab626499bfad service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:41.059641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f05e7a-01c3-4ed9-bd2a-ab626499bfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:41.061223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-97f05e7a-01c3-4ed9-bd2a-ab626499bfad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:41.170705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f05e7a-01c3-4ed9-bd2a-ab626499bfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:41.172141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f05e7a-01c3-4ed9-bd2a-ab626499bfad service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:41.191321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 725/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:43.394278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f5794-de51-42c8-a39b-2f121a3b4d8c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:43.394803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f5794-de51-42c8-a39b-2f121a3b4d8c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:43.394803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f5794-de51-42c8-a39b-2f121a3b4d8c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:43.396186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:43.401363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df15b6-a219-4a90-9c22-c0d6b65d2489 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:43.401772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df15b6-a219-4a90-9c22-c0d6b65d2489 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:43.401904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df15b6-a219-4a90-9c22-c0d6b65d2489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:43.468278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-95df15b6-a219-4a90-9c22-c0d6b65d2489 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:43.469474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-95df15b6-a219-4a90-9c22-c0d6b65d2489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:43.478621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:43.570196 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:43.855619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f5794-de51-42c8-a39b-2f121a3b4d8c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:43.857184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c07f5794-de51-42c8-a39b-2f121a3b4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:43.960334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f5794-de51-42c8-a39b-2f121a3b4d8c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:44.015192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:44.034173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b480-842b-45be-8ba0-34e16b246832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:44.034908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b480-842b-45be-8ba0-34e16b246832 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:44.035185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b480-842b-45be-8ba0-34e16b246832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:44.035456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b480-842b-45be-8ba0-34e16b246832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:44.037045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7f63b480-842b-45be-8ba0-34e16b246832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:44.150131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63b480-842b-45be-8ba0-34e16b246832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:44.151499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63b480-842b-45be-8ba0-34e16b246832 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:44.169023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 735/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:46.360359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758eaa-fc19-41af-837c-db70bfb95e0b None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:46.360988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758eaa-fc19-41af-837c-db70bfb95e0b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:46.360988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758eaa-fc19-41af-837c-db70bfb95e0b None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:46.362817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:46.368023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca311be-a292-4094-80b1-e9d43cfe2f8c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:46.368479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca311be-a292-4094-80b1-e9d43cfe2f8c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:46.368587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca311be-a292-4094-80b1-e9d43cfe2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:46.434995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8ca311be-a292-4094-80b1-e9d43cfe2f8c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:46.436187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8ca311be-a292-4094-80b1-e9d43cfe2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:46.474853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:46.533222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:46.825310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758eaa-fc19-41af-837c-db70bfb95e0b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:46.826879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e6758eaa-fc19-41af-837c-db70bfb95e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:46.931063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758eaa-fc19-41af-837c-db70bfb95e0b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:46.969272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:47.006042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4b520-ebf1-41b1-83e7-7f3b8a47f960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:47.006656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b520-ebf1-41b1-83e7-7f3b8a47f960 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:47.006928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b520-ebf1-41b1-83e7-7f3b8a47f960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:47.007195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4b520-ebf1-41b1-83e7-7f3b8a47f960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:47.008757 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4ee4b520-ebf1-41b1-83e7-7f3b8a47f960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:47.119031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4b520-ebf1-41b1-83e7-7f3b8a47f960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:47.120437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4b520-ebf1-41b1-83e7-7f3b8a47f960 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:47.139001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 728/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:49.290807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfefa5-a425-463b-ad3e-5439169d91a8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:49.291375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfefa5-a425-463b-ad3e-5439169d91a8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:49.291375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bfefa5-a425-463b-ad3e-5439169d91a8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:49.292700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 30 19:22:49.298595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49c77-a6e6-48a4-86cc-a754c4da2d9c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:49.299004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49c77-a6e6-48a4-86cc-a754c4da2d9c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:49.299260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a49c77-a6e6-48a4-86cc-a754c4da2d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:49.369975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e2a49c77-a6e6-48a4-86cc-a754c4da2d9c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:49.371182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e2a49c77-a6e6-48a4-86cc-a754c4da2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:49.389306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:49.467963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:49.754737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfefa5-a425-463b-ad3e-5439169d91a8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:49.756270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-25bfefa5-a425-463b-ad3e-5439169d91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:49.861702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bfefa5-a425-463b-ad3e-5439169d91a8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:49.927184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:49.933697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2213e8-04a4-4ffc-91bc-0c302ab9f995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:49.934322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2213e8-04a4-4ffc-91bc-0c302ab9f995 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:49.934602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2213e8-04a4-4ffc-91bc-0c302ab9f995 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:49.934867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2213e8-04a4-4ffc-91bc-0c302ab9f995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:49.936439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0c2213e8-04a4-4ffc-91bc-0c302ab9f995 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:50.044698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2213e8-04a4-4ffc-91bc-0c302ab9f995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:50.046075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2213e8-04a4-4ffc-91bc-0c302ab9f995 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:50.064649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 738/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:22:52.211932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65edf2a-6241-433a-8d48-6e6d59ca3db6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:52.212503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65edf2a-6241-433a-8d48-6e6d59ca3db6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:52.212503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65edf2a-6241-433a-8d48-6e6d59ca3db6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:52.213850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:22:52.219929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6539-7b71-4b7f-98c0-2e7a468e6083 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:52.220632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6539-7b71-4b7f-98c0-2e7a468e6083 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:52.220950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef6539-7b71-4b7f-98c0-2e7a468e6083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:52.288730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-87ef6539-7b71-4b7f-98c0-2e7a468e6083 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:22:52.289976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-87ef6539-7b71-4b7f-98c0-2e7a468e6083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:52.338421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:52.388166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:22:52.690205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65edf2a-6241-433a-8d48-6e6d59ca3db6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:22:52.691747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b65edf2a-6241-433a-8d48-6e6d59ca3db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:52.795382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65edf2a-6241-433a-8d48-6e6d59ca3db6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:22:52.842500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:22:52.868795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522068e6-13e5-4bfc-b205-26ba09308b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:22:52.869402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522068e6-13e5-4bfc-b205-26ba09308b5a service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:22:52.869674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522068e6-13e5-4bfc-b205-26ba09308b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:22:52.869940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522068e6-13e5-4bfc-b205-26ba09308b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:22:52.871545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-522068e6-13e5-4bfc-b205-26ba09308b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:22:52.980472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522068e6-13e5-4bfc-b205-26ba09308b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:22:52.981831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522068e6-13e5-4bfc-b205-26ba09308b5a service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:22:52.999973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 731/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:02.386718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=22 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:02.997734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=66 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:13.150460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede394-e22b-4376-85fa-367c69e77c44 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:13.150989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede394-e22b-4376-85fa-367c69e77c44 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:13.150989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbede394-e22b-4376-85fa-367c69e77c44 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:13.152381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 740/1471] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:13.158136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ea48-9c76-4631-b99b-e914cf42d7e1 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:13.158612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ea48-9c76-4631-b99b-e914cf42d7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:13.158729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262ea48-9c76-4631-b99b-e914cf42d7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:13.226770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8262ea48-9c76-4631-b99b-e914cf42d7e1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:13.227970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8262ea48-9c76-4631-b99b-e914cf42d7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:13.325007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 732/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:13.631938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f940b-12b2-4171-abd3-56263bf73f60 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:13.632226 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f940b-12b2-4171-abd3-56263bf73f60 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:13.632502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f940b-12b2-4171-abd3-56263bf73f60 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:13.633896 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 741/1473] 10.222.0.18 () {54 vars in 962 bytes} [Fri Sep 30 19:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:13.638890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983f6ea-c498-4a1e-8195-25d71cac2652 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:13.639180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983f6ea-c498-4a1e-8195-25d71cac2652 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:13.639523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983f6ea-c498-4a1e-8195-25d71cac2652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:13.717554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3983f6ea-c498-4a1e-8195-25d71cac2652 None None] MFA Rules not processed for user `9f5190ae783a4c89b51797729aaaa6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:13.718946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3983f6ea-c498-4a1e-8195-25d71cac2652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:13.741420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:13.799517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 733/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Fri Sep 30 19:23:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:13.807455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f940b-12b2-4171-abd3-56263bf73f60 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:23:13.808964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-139f940b-12b2-4171-abd3-56263bf73f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:13.911515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f940b-12b2-4171-abd3-56263bf73f60 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:23:13.985857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de67ef1-24e7-4d10-962d-436a250055c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5190ae783a4c89b51797729aaaa6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:23:13.986489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de67ef1-24e7-4d10-962d-436a250055c5 service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:13.986770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de67ef1-24e7-4d10-962d-436a250055c5 service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:13.987044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de67ef1-24e7-4d10-962d-436a250055c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:13.988643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1de67ef1-24e7-4d10-962d-436a250055c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:14.042815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:14.099238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de67ef1-24e7-4d10-962d-436a250055c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:23:14.100657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de67ef1-24e7-4d10-962d-436a250055c5 service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:23:14.118956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 742/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:16.404600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707392e-aeef-484b-b82c-3de02b58ea82 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:16.405735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707392e-aeef-484b-b82c-3de02b58ea82 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:16.406081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707392e-aeef-484b-b82c-3de02b58ea82 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:16.407448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 734/1476] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:16.412652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e95c7-cda3-4188-be12-f15e2dca675c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:16.413069 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e95c7-cda3-4188-be12-f15e2dca675c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:16.413237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e95c7-cda3-4188-be12-f15e2dca675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:16.480483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-027e95c7-cda3-4188-be12-f15e2dca675c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:16.481677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-027e95c7-cda3-4188-be12-f15e2dca675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:16.577964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 743/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:16.862505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707392e-aeef-484b-b82c-3de02b58ea82 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:23:16.864023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c707392e-aeef-484b-b82c-3de02b58ea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:16.994854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707392e-aeef-484b-b82c-3de02b58ea82 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:23:17.045395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:17.092981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d3770-75f7-4f74-8e3c-e6d042ca06b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:23:17.093587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3770-75f7-4f74-8e3c-e6d042ca06b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:17.093867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3770-75f7-4f74-8e3c-e6d042ca06b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:17.094175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3770-75f7-4f74-8e3c-e6d042ca06b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:17.094814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d3770-75f7-4f74-8e3c-e6d042ca06b9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:23:17.096633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-967d3770-75f7-4f74-8e3c-e6d042ca06b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:23:17.096633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:23:17.096633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:23:17.097794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d3770-75f7-4f74-8e3c-e6d042ca06b9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:23:17.116853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 735/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Fri Sep 30 19:23:16 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:23:19.346156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4479a0-b493-4f7e-a92c-4fa0814b1403 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:19.346693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4479a0-b493-4f7e-a92c-4fa0814b1403 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:19.346693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4479a0-b493-4f7e-a92c-4fa0814b1403 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:19.347989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 744/1479] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:19.353633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b8c5-ff8a-4b49-bb67-119b45f2c767 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:19.354104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b8c5-ff8a-4b49-bb67-119b45f2c767 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:19.354216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b8c5-ff8a-4b49-bb67-119b45f2c767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:19.422307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ffc1b8c5-ff8a-4b49-bb67-119b45f2c767 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:19.423523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ffc1b8c5-ff8a-4b49-bb67-119b45f2c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:19.519638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 736/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:19.816122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4479a0-b493-4f7e-a92c-4fa0814b1403 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:23:19.817745 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4d4479a0-b493-4f7e-a92c-4fa0814b1403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:19.828133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:19.963386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4479a0-b493-4f7e-a92c-4fa0814b1403 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:23:20.050927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:20.088986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b38d-cb17-4a10-8295-c3ef57c7d779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:23:20.089585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b38d-cb17-4a10-8295-c3ef57c7d779 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:20.089861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b38d-cb17-4a10-8295-c3ef57c7d779 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:20.090158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b38d-cb17-4a10-8295-c3ef57c7d779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:20.091735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bf32b38d-cb17-4a10-8295-c3ef57c7d779 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:20.180135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32b38d-cb17-4a10-8295-c3ef57c7d779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:23:20.181711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32b38d-cb17-4a10-8295-c3ef57c7d779 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:23:20.199937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 745/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:22.583837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe54a1-d539-4003-a602-10bd4ff26af6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:22.584401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe54a1-d539-4003-a602-10bd4ff26af6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:22.584401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe54a1-d539-4003-a602-10bd4ff26af6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:22.585704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 737/1482] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:22.591367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581cfe-0435-44e9-9d21-830f47672e42 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:22.591847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581cfe-0435-44e9-9d21-830f47672e42 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:22.592509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a581cfe-0435-44e9-9d21-830f47672e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:22.660060 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7a581cfe-0435-44e9-9d21-830f47672e42 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:22.661266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7a581cfe-0435-44e9-9d21-830f47672e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:22.707173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:22.757902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 746/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:23.050182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe54a1-d539-4003-a602-10bd4ff26af6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:23:23.051753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ecbe54a1-d539-4003-a602-10bd4ff26af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:23.078257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:23.158813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe54a1-d539-4003-a602-10bd4ff26af6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:23:23.233089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f15fb-d87e-42e0-af93-aa9223a92d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:23:23.233684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f15fb-d87e-42e0-af93-aa9223a92d28 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:23.233958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f15fb-d87e-42e0-af93-aa9223a92d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:23.234263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f15fb-d87e-42e0-af93-aa9223a92d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:23.235827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fe5f15fb-d87e-42e0-af93-aa9223a92d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:23.309762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:23.345016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f15fb-d87e-42e0-af93-aa9223a92d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:23:23.346478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f15fb-d87e-42e0-af93-aa9223a92d28 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:23:23.481558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 738/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:25.686207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86717f-c933-4455-84a5-68679a55be6e None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:25.686809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86717f-c933-4455-84a5-68679a55be6e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:25.686809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86717f-c933-4455-84a5-68679a55be6e None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:25.688117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 747/1485] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:25.693321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79b34-ff51-4444-88d5-7b64b10d3995 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:25.693753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79b34-ff51-4444-88d5-7b64b10d3995 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:25.693851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d79b34-ff51-4444-88d5-7b64b10d3995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:25.762558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-73d79b34-ff51-4444-88d5-7b64b10d3995 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:25.764305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-73d79b34-ff51-4444-88d5-7b64b10d3995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:25.860408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 739/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:26.154855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86717f-c933-4455-84a5-68679a55be6e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:23:26.156400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1b86717f-c933-4455-84a5-68679a55be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:26.259691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86717f-c933-4455-84a5-68679a55be6e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:23:26.332128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:26.333822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7116571-ef5f-4678-a689-76a72495caa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:23:26.334486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116571-ef5f-4678-a689-76a72495caa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:26.334799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116571-ef5f-4678-a689-76a72495caa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:26.335260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116571-ef5f-4678-a689-76a72495caa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:26.337295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e7116571-ef5f-4678-a689-76a72495caa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:26.445772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7116571-ef5f-4678-a689-76a72495caa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:23:26.447251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7116571-ef5f-4678-a689-76a72495caa5 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:23:26.464674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 748/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:28.819458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fd8f-0926-4c0b-a2c3-d778a861f419 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:28.820029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fd8f-0926-4c0b-a2c3-d778a861f419 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:28.820029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130fd8f-0926-4c0b-a2c3-d778a861f419 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:28.821303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 740/1488] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:28.827280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40efe8-2dd7-473e-9b34-338e41ff9f8b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:28.827683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40efe8-2dd7-473e-9b34-338e41ff9f8b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:28.827843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40efe8-2dd7-473e-9b34-338e41ff9f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:28.895366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9f40efe8-2dd7-473e-9b34-338e41ff9f8b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:28.896559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9f40efe8-2dd7-473e-9b34-338e41ff9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:28.947364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:28.990366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 749/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:29.282340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130fd8f-0926-4c0b-a2c3-d778a861f419 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:23:29.283880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0130fd8f-0926-4c0b-a2c3-d778a861f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:29.320930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:29.390542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130fd8f-0926-4c0b-a2c3-d778a861f419 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:23:29.463242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fbf9a-064a-4efc-be0d-86059ab0d164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:23:29.463844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fbf9a-064a-4efc-be0d-86059ab0d164 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:29.464124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fbf9a-064a-4efc-be0d-86059ab0d164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:29.464396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fbf9a-064a-4efc-be0d-86059ab0d164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:29.465978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-877fbf9a-064a-4efc-be0d-86059ab0d164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:29.546224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:29.574957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fbf9a-064a-4efc-be0d-86059ab0d164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:23:29.577466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fbf9a-064a-4efc-be0d-86059ab0d164 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:23:29.595721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 741/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:31.909730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825015a-c44e-4475-8a27-aaf9751edb92 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:31.910346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825015a-c44e-4475-8a27-aaf9751edb92 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:31.910446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825015a-c44e-4475-8a27-aaf9751edb92 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:31.911864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 750/1491] 10.222.0.18 () {54 vars in 927 bytes} [Fri Sep 30 19:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:23:31.917189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb68cf-4953-45fe-87fa-56f896e90206 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:31.917612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb68cf-4953-45fe-87fa-56f896e90206 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:31.917741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb68cf-4953-45fe-87fa-56f896e90206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:31.983473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ecdb68cf-4953-45fe-87fa-56f896e90206 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:23:31.984682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ecdb68cf-4953-45fe-87fa-56f896e90206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:32.084632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 742/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Fri Sep 30 19:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:23:32.375351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825015a-c44e-4475-8a27-aaf9751edb92 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:23:32.376895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e825015a-c44e-4475-8a27-aaf9751edb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:32.490194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825015a-c44e-4475-8a27-aaf9751edb92 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:23:32.563502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842bf37-3568-40f9-95d7-0e7310c28ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:23:32.564101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842bf37-3568-40f9-95d7-0e7310c28ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:23:32.564376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842bf37-3568-40f9-95d7-0e7310c28ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:23:32.564644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842bf37-3568-40f9-95d7-0e7310c28ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:23:32.566238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9842bf37-3568-40f9-95d7-0e7310c28ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:23:32.574611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:32.676198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842bf37-3568-40f9-95d7-0e7310c28ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:23:32.677547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842bf37-3568-40f9-95d7-0e7310c28ee0 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:23:32.695816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 751/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:23:42.083082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=82 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:23:42.693530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=50 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:52.179766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:52.180357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:52.180357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:52.255288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:24:52.257092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:52.350006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 743/1494] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:24:52.357989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05488fc7-4dad-41cc-8f26-321e0baed9e0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:52.358530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05488fc7-4dad-41cc-8f26-321e0baed9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:52.358530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05488fc7-4dad-41cc-8f26-321e0baed9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:52.435493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-05488fc7-4dad-41cc-8f26-321e0baed9e0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:24:52.436671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-05488fc7-4dad-41cc-8f26-321e0baed9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:52.536002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 752/1495] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:24:52.541148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:52.542390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:52.554181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7749708-218d-4c8b-86e6-85e28b40cb71 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:52.614375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:52.651110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:52.651722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:52.651997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:52.652268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:52.652901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:24:52.653202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:52.654241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:52.654241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:24:52.654241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:24:52.655121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:52.666971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 744/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:24:52.675220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05488fc7-4dad-41cc-8f26-321e0baed9e0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:52.684898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05488fc7-4dad-41cc-8f26-321e0baed9e0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:52.746461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:52.780750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:52.781359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:52.781631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:52.781897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:52.782564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:52.784295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:52.784295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 30 19:24:52.784295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: Sep 30 19:24:52.785576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:52.843274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 753/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:24:52 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:24:52.847486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:52.849297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:52.883323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14bf7e-750a-41a6-9908-5976e33e23fc admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:52.976021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:52.976621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:52.976900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:52.977173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:52.977790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:52.978832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:52.978832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:24:52.978832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:24:52.980031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:53.022547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 745/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:24:52 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:24:53.026714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:53.028245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:53.092661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211141a-093a-41b6-8a23-505cb08ddffe admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:53.182332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:53.192748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:53.193885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:53.194194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:53.194466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:53.195104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:53.196110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:53.196110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 30 19:24:53.196110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: Sep 30 19:24:53.196993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:53.209806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 754/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:24:53.214127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:53.215707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:53.227422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c452d-7009-4273-aebe-09026fc6b551 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:53.252048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:53.321354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fed016-1ed1-4f06-b20d-796b19a14272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:53.321951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fed016-1ed1-4f06-b20d-796b19a14272 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:53.322253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fed016-1ed1-4f06-b20d-796b19a14272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:53.322527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fed016-1ed1-4f06-b20d-796b19a14272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:53.323156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fed016-1ed1-4f06-b20d-796b19a14272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:53.324158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-72fed016-1ed1-4f06-b20d-796b19a14272 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:53.324158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:24:53.324158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:24:53.325035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fed016-1ed1-4f06-b20d-796b19a14272 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:53.337561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 746/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:24:53.341890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:53.343475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:53.376462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10753b58-4aee-488a-b88a-7d0a4d1c5330 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:53.469514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e966f-aa09-415b-943d-0dbdaf452167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:53.470114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e966f-aa09-415b-943d-0dbdaf452167 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:53.470399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e966f-aa09-415b-943d-0dbdaf452167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:53.470666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e966f-aa09-415b-943d-0dbdaf452167 admin admin] PATH_INFO: `/v3/projects/43ba02c88f34491faaed8249fad8f0d6/users/377af6556f5c45c79d8c6d8828a434a3/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:53.493954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e966f-aa09-415b-943d-0dbdaf452167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ba02c88f34491faaed8249fad8f0d6, user_id=377af6556f5c45c79d8c6d8828a434a3, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:53.495019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-728e966f-aa09-415b-943d-0dbdaf452167 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:53.495019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 30 19:24:53.495019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: Sep 30 19:24:53.496943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e966f-aa09-415b-943d-0dbdaf452167 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:53.520789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 755/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:24:53 2022] PUT /identity/v3/projects/43ba02c88f34491faaed8249fad8f0d6/users/377af6556f5c45c79d8c6d8828a434a3/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:24:53.533376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290aa0-c1ea-4b8f-a556-fa205ef2a93b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:53.533663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290aa0-c1ea-4b8f-a556-fa205ef2a93b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:53.533936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290aa0-c1ea-4b8f-a556-fa205ef2a93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:53.590534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d4290aa0-c1ea-4b8f-a556-fa205ef2a93b None None] MFA Rules not processed for user `377af6556f5c45c79d8c6d8828a434a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:24:53.591726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d4290aa0-c1ea-4b8f-a556-fa205ef2a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:53.670064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 747/1502] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:24:53.683053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424bedc-e344-449f-899e-ef2b5fe82934 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:53.683345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424bedc-e344-449f-899e-ef2b5fe82934 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:53.683621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424bedc-e344-449f-899e-ef2b5fe82934 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:53.684992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 756/1503] 10.222.0.18 () {54 vars in 963 bytes} [Fri Sep 30 19:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:24:53.689561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587363-92a5-4b4e-acf8-6b3adca24ff8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:53.689846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587363-92a5-4b4e-acf8-6b3adca24ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:53.690159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587363-92a5-4b4e-acf8-6b3adca24ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:53.723280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:53.777654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-fa587363-92a5-4b4e-acf8-6b3adca24ff8 None None] MFA Rules not processed for user `d267807215f54e2ea4c91383b178ee25`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:24:53.778937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fa587363-92a5-4b4e-acf8-6b3adca24ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:53.867309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 748/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Fri Sep 30 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:24:53.875101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424bedc-e344-449f-899e-ef2b5fe82934 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:53.876611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b424bedc-e344-449f-899e-ef2b5fe82934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:53.928634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:53.990970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424bedc-e344-449f-899e-ef2b5fe82934 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:54.063937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:54.064611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:54.064868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:54.065136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:54.066784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:54.166843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:54.168264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:54.171721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:54.185839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 757/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:24:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:24:54.233692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc682-417f-4358-b868-5a5d3b0f0988 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:54.234127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc682-417f-4358-b868-5a5d3b0f0988 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:54.234268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fc682-417f-4358-b868-5a5d3b0f0988 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:54.235838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 749/1506] 10.222.0.18 () {52 vars in 830 bytes} [Fri Sep 30 19:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:24:54.239354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:54.240749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:54.338166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fdc60-f0e1-4f94-9a1f-d762bdbdcc54 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:54.433020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:54.433739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:54.433905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:54.434199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] PATH_INFO: `/v3/users/377af6556f5c45c79d8c6d8828a434a3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:54.448838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] RBAC: Authorizing `identity:delete_user(user_id=377af6556f5c45c79d8c6d8828a434a3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:54.449984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:54.449984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 30 19:24:54.449984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: Sep 30 19:24:54.451265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:54.462722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:54.520353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377af6556f5c45c79d8c6d8828a434a3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:54.520882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377af6556f5c45c79d8c6d8828a434a3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:54.521351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377af6556f5c45c79d8c6d8828a434a3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:54.535265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377af6556f5c45c79d8c6d8828a434a3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:54.544741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377af6556f5c45c79d8c6d8828a434a3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:54.573836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 758/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:24:54 2022] DELETE /identity/v3/users/377af6556f5c45c79d8c6d8828a434a3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:24:54.578264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:54.578549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:54.578824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:54.635323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:24:54.636450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:54.712871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:54.726968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 750/1508] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:24:54.737133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:54.738426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:54.835987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95d9e4-707e-43dc-88c1-e63122c5803d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:54.889466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:24:54.909073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c137b0-cb46-40da-9ee6-d3cad65dbccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:54.909673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c137b0-cb46-40da-9ee6-d3cad65dbccb service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:54.909948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c137b0-cb46-40da-9ee6-d3cad65dbccb service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:54.910244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c137b0-cb46-40da-9ee6-d3cad65dbccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:54.912338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c2c137b0-cb46-40da-9ee6-d3cad65dbccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:55.019322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c137b0-cb46-40da-9ee6-d3cad65dbccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:55.020734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c137b0-cb46-40da-9ee6-d3cad65dbccb service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:55.039878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 759/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:24:55.392233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:24:55.393488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:24:55.404801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ff9bf-1515-402b-ab88-670c68d0b5d7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:24:55.503814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:24:55.504440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:24:55.504715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:24:55.504980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] PATH_INFO: `/v3/projects/43ba02c88f34491faaed8249fad8f0d6` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:24:55.514647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ba02c88f34491faaed8249fad8f0d6)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:24:55.515660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:24:55.515660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:24:55.515660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:24:55.516849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:24:55.576647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ba02c88f34491faaed8249fad8f0d6', 'request_id': 'req-554bcb3c-2200-4618-a54a-b5fc9ecfd513'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:55.590804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ba02c88f34491faaed8249fad8f0d6', 'request_id': 'req-554bcb3c-2200-4618-a54a-b5fc9ecfd513'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:55.600546 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ba02c88f34491faaed8249fad8f0d6', 'request_id': 'req-554bcb3c-2200-4618-a54a-b5fc9ecfd513'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:55.623406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] The token cache is being invalidate because project 43ba02c88f34491faaed8249fad8f0d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:24:55.623692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:55.624201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-554bcb3c-2200-4618-a54a-b5fc9ecfd513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:24:55.625486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 751/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:24:55 2022] DELETE /identity/v3/projects/43ba02c88f34491faaed8249fad8f0d6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:25:05.036920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=62 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:25:05.621467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:26:24.683500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f722-d00e-4053-903b-0c9995d15ecd None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:24.684109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f722-d00e-4053-903b-0c9995d15ecd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:24.684109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1f722-d00e-4053-903b-0c9995d15ecd None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:24.685405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:24.690351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a0486-6c25-48ec-879d-fedc09aea92b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:24.690811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a0486-6c25-48ec-879d-fedc09aea92b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:24.690918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a0486-6c25-48ec-879d-fedc09aea92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:24.771878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d61a0486-6c25-48ec-879d-fedc09aea92b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:24.772997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d61a0486-6c25-48ec-879d-fedc09aea92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:24.877843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:25.060483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1f722-d00e-4053-903b-0c9995d15ecd None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:25.062900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c8d1f722-d00e-4053-903b-0c9995d15ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:25.202614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1f722-d00e-4053-903b-0c9995d15ecd None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:25.208419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afeed6-d64f-46c4-8dae-659878578871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:25.209034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afeed6-d64f-46c4-8dae-659878578871 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:25.209316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afeed6-d64f-46c4-8dae-659878578871 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:25.209591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afeed6-d64f-46c4-8dae-659878578871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:25.219317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afeed6-d64f-46c4-8dae-659878578871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:25.221352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3afeed6-d64f-46c4-8dae-659878578871 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:25.233920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 761/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:26:26.368622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901cb4-ff44-4f40-9fed-5956f765206f None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:26.369199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901cb4-ff44-4f40-9fed-5956f765206f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:26.370226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c901cb4-ff44-4f40-9fed-5956f765206f None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:26.371586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:26.378639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78eba-c581-4dbd-9192-b6b949ff796d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:26.379132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78eba-c581-4dbd-9192-b6b949ff796d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:26.379238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff78eba-c581-4dbd-9192-b6b949ff796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:26.400052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2ff78eba-c581-4dbd-9192-b6b949ff796d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:26.401268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2ff78eba-c581-4dbd-9192-b6b949ff796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:26.410026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:26.572470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c901cb4-ff44-4f40-9fed-5956f765206f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:26.591555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c901cb4-ff44-4f40-9fed-5956f765206f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:26.601385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369bb79-3549-48d6-938d-dafacb1b378b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:26.602013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bb79-3549-48d6-938d-dafacb1b378b service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:26.602334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bb79-3549-48d6-938d-dafacb1b378b service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:26.602609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bb79-3549-48d6-938d-dafacb1b378b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:26.611643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369bb79-3549-48d6-938d-dafacb1b378b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:26.613268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369bb79-3549-48d6-938d-dafacb1b378b service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:26.623955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 754/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:26:26.729888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60706a1-d8eb-482d-b245-adf841a46ba3 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:26.730303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60706a1-d8eb-482d-b245-adf841a46ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:26.730609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60706a1-d8eb-482d-b245-adf841a46ba3 None None] PATH_INFO: `/v3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:26.731990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 763/1517] 10.222.0.39 () {54 vars in 925 bytes} [Fri Sep 30 19:26:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:26:26.739286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5945e4-0d33-42f5-bf36-10bf0a46fc3f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:26.739663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5945e4-0d33-42f5-bf36-10bf0a46fc3f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:26.739840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5945e4-0d33-42f5-bf36-10bf0a46fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:26.818360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4c5945e4-0d33-42f5-bf36-10bf0a46fc3f None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:26.819615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4c5945e4-0d33-42f5-bf36-10bf0a46fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:26.845603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:26:26.912460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 755/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Fri Sep 30 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:26:30.503455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64948a87-027b-44a3-8bef-9bf21f343b08 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:30.503886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64948a87-027b-44a3-8bef-9bf21f343b08 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:30.504003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64948a87-027b-44a3-8bef-9bf21f343b08 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:30.505311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 764/1519] 10.222.0.18 () {54 vars in 961 bytes} [Fri Sep 30 19:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:30.510400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced95fb9-5bc7-45e9-a13d-d3f854612d16 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:30.510836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced95fb9-5bc7-45e9-a13d-d3f854612d16 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:30.510986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced95fb9-5bc7-45e9-a13d-d3f854612d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:30.531394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ced95fb9-5bc7-45e9-a13d-d3f854612d16 None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:30.532586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ced95fb9-5bc7-45e9-a13d-d3f854612d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:30.540963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 756/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Sep 30 19:26:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:30.549007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64948a87-027b-44a3-8bef-9bf21f343b08 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:30.562249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64948a87-027b-44a3-8bef-9bf21f343b08 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:30.567126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefb660-b48c-4959-b8ac-40ec83b3090a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:30.567707 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefb660-b48c-4959-b8ac-40ec83b3090a service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:30.567982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefb660-b48c-4959-b8ac-40ec83b3090a service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:30.568249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefb660-b48c-4959-b8ac-40ec83b3090a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:30.577431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefb660-b48c-4959-b8ac-40ec83b3090a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:30.579218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefb660-b48c-4959-b8ac-40ec83b3090a service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:30.588796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 765/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:26:38.145799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c41cb6-a4e1-4968-bcd2-06fc1cf058f6 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:38.146417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c41cb6-a4e1-4968-bcd2-06fc1cf058f6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:38.146417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c41cb6-a4e1-4968-bcd2-06fc1cf058f6 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:38.147701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:38.153851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a2fe-10c0-43b6-911a-ca47abc2197b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:38.154314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a2fe-10c0-43b6-911a-ca47abc2197b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:38.154415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239a2fe-10c0-43b6-911a-ca47abc2197b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:38.174944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9239a2fe-10c0-43b6-911a-ca47abc2197b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:38.176139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9239a2fe-10c0-43b6-911a-ca47abc2197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:38.183836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:38.335482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c41cb6-a4e1-4968-bcd2-06fc1cf058f6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:38.350287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c41cb6-a4e1-4968-bcd2-06fc1cf058f6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:38.355590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724dff9-d45a-48d6-af47-5c4c46c56f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:38.356176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724dff9-d45a-48d6-af47-5c4c46c56f8d service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:38.356454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724dff9-d45a-48d6-af47-5c4c46c56f8d service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:38.356722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724dff9-d45a-48d6-af47-5c4c46c56f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:38.365192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724dff9-d45a-48d6-af47-5c4c46c56f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:38.366789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724dff9-d45a-48d6-af47-5c4c46c56f8d service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:38.376122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 758/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:26:39.475054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386ade-56bb-41c3-870f-ac67bfbfca10 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:39.475591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386ade-56bb-41c3-870f-ac67bfbfca10 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:39.475591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386ade-56bb-41c3-870f-ac67bfbfca10 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:39.476867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 30 19:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:39.483031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf713-0de1-4c3b-afb1-95964bf807d8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:39.484024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf713-0de1-4c3b-afb1-95964bf807d8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:39.484136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bf713-0de1-4c3b-afb1-95964bf807d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:39.503639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-0d0bf713-0de1-4c3b-afb1-95964bf807d8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:39.504820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0d0bf713-0de1-4c3b-afb1-95964bf807d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:39.512556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 30 19:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:39.676686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386ade-56bb-41c3-870f-ac67bfbfca10 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:39.696536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386ade-56bb-41c3-870f-ac67bfbfca10 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:39.701865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edf343-b39e-4de3-8455-57a7fbc8a319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:39.702582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf343-b39e-4de3-8455-57a7fbc8a319 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:39.702858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf343-b39e-4de3-8455-57a7fbc8a319 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:39.703131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edf343-b39e-4de3-8455-57a7fbc8a319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:39.711121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edf343-b39e-4de3-8455-57a7fbc8a319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:39.712688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edf343-b39e-4de3-8455-57a7fbc8a319 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:39.723111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 768/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:26:43.578931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808236-d7a6-47a6-adc5-cd205d3a7936 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:43.579416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808236-d7a6-47a6-adc5-cd205d3a7936 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:43.579521 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808236-d7a6-47a6-adc5-cd205d3a7936 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:43.580787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:43.585909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4a56f-eabb-4458-9a52-67b398e85a2f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:43.586335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4a56f-eabb-4458-9a52-67b398e85a2f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:43.586508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4a56f-eabb-4458-9a52-67b398e85a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:43.606281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-41f4a56f-eabb-4458-9a52-67b398e85a2f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:43.607477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-41f4a56f-eabb-4458-9a52-67b398e85a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:43.615866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:43.909123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808236-d7a6-47a6-adc5-cd205d3a7936 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:43.910846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-73808236-d7a6-47a6-adc5-cd205d3a7936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:43.989253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808236-d7a6-47a6-adc5-cd205d3a7936 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:43.992805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8922958-9ecc-41db-8c9f-09444ecd7aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:43.993416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922958-9ecc-41db-8c9f-09444ecd7aaa service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:43.993681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922958-9ecc-41db-8c9f-09444ecd7aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:43.993949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8922958-9ecc-41db-8c9f-09444ecd7aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:44.003455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8922958-9ecc-41db-8c9f-09444ecd7aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:44.004881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8922958-9ecc-41db-8c9f-09444ecd7aaa service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:44.014107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 761/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:26:46.181249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54b9a8-0e76-48cd-87c3-fe6feb8d2deb None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:46.181776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54b9a8-0e76-48cd-87c3-fe6feb8d2deb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:46.181776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54b9a8-0e76-48cd-87c3-fe6feb8d2deb None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:46.183085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:46.189060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48001b2-5120-4741-bd96-44713e2b6e64 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:46.189512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48001b2-5120-4741-bd96-44713e2b6e64 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:46.189610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48001b2-5120-4741-bd96-44713e2b6e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:46.208902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e48001b2-5120-4741-bd96-44713e2b6e64 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:46.210158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e48001b2-5120-4741-bd96-44713e2b6e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:46.218413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:46.507866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54b9a8-0e76-48cd-87c3-fe6feb8d2deb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:46.509554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ea54b9a8-0e76-48cd-87c3-fe6feb8d2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:46.522689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54b9a8-0e76-48cd-87c3-fe6feb8d2deb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:46.526175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91844a-8abd-4f00-9a34-5a89abde3301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:46.526772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91844a-8abd-4f00-9a34-5a89abde3301 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:46.527048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91844a-8abd-4f00-9a34-5a89abde3301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:46.527318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91844a-8abd-4f00-9a34-5a89abde3301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:46.536864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91844a-8abd-4f00-9a34-5a89abde3301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:46.538307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91844a-8abd-4f00-9a34-5a89abde3301 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:46.548462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 771/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:26:50.489561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2795-3147-4f99-a53c-9c3747368d31 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:50.490163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2795-3147-4f99-a53c-9c3747368d31 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:50.490163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2795-3147-4f99-a53c-9c3747368d31 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:50.491485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:50.496820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3404-4964-43d6-8a10-e028f456f66d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:50.497240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3404-4964-43d6-8a10-e028f456f66d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:50.497356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3404-4964-43d6-8a10-e028f456f66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:50.517036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fafd3404-4964-43d6-8a10-e028f456f66d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:50.518261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fafd3404-4964-43d6-8a10-e028f456f66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:50.525915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:50.830825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2795-3147-4f99-a53c-9c3747368d31 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:50.832512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-74cb2795-3147-4f99-a53c-9c3747368d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:50.898541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:26:50.913121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2795-3147-4f99-a53c-9c3747368d31 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:50.916658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b555-b94d-4ae9-aeda-d0bae414ac28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:50.917253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b555-b94d-4ae9-aeda-d0bae414ac28 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:50.917526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b555-b94d-4ae9-aeda-d0bae414ac28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:50.917797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b555-b94d-4ae9-aeda-d0bae414ac28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:50.926644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b555-b94d-4ae9-aeda-d0bae414ac28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:50.928048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b555-b94d-4ae9-aeda-d0bae414ac28 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:50.937959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 764/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:26:53.126871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f5bc-cb5f-4cf7-864b-99e654d7ce2c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:53.127428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f5bc-cb5f-4cf7-864b-99e654d7ce2c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:53.127428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f5bc-cb5f-4cf7-864b-99e654d7ce2c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:53.128777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 30 19:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:26:53.134123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d430d8-5b89-4363-8156-b541b89bc8c3 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:53.134528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d430d8-5b89-4363-8156-b541b89bc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:53.134677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d430d8-5b89-4363-8156-b541b89bc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:53.154457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c8d430d8-5b89-4363-8156-b541b89bc8c3 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:26:53.155628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c8d430d8-5b89-4363-8156-b541b89bc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:53.163269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 30 19:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:26:53.473819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4f5bc-cb5f-4cf7-864b-99e654d7ce2c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:26:53.475471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e6b4f5bc-cb5f-4cf7-864b-99e654d7ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:26:53.488205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4f5bc-cb5f-4cf7-864b-99e654d7ce2c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:26:53.491663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4c39-93a4-48f5-ad8e-43d31c239d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:26:53.492248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4c39-93a4-48f5-ad8e-43d31c239d03 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:26:53.492519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4c39-93a4-48f5-ad8e-43d31c239d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:26:53.492785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4c39-93a4-48f5-ad8e-43d31c239d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:26:53.501385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a4c39-93a4-48f5-ad8e-43d31c239d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:26:53.502821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a4c39-93a4-48f5-ad8e-43d31c239d03 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:26:53.512256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 774/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:26:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:27:03.149488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=11 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:27:03.508299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:20.747241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037fb7-0522-4e47-976a-d45df78c24c8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:20.753583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037fb7-0522-4e47-976a-d45df78c24c8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:20.753583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037fb7-0522-4e47-976a-d45df78c24c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:20.775191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-7e037fb7-0522-4e47-976a-d45df78c24c8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:20.776808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7e037fb7-0522-4e47-976a-d45df78c24c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:20.777391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691dae-1dc2-4ccc-b212-b60deb24ef3e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:20.777949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691dae-1dc2-4ccc-b212-b60deb24ef3e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:20.777949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0691dae-1dc2-4ccc-b212-b60deb24ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:20.795459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 766/1540] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:20.805234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166060-a0c1-45e2-916f-69c0eb88f9be None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:20.805880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166060-a0c1-45e2-916f-69c0eb88f9be None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:20.806404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166060-a0c1-45e2-916f-69c0eb88f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:20.812914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e0691dae-1dc2-4ccc-b212-b60deb24ef3e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:20.814248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e0691dae-1dc2-4ccc-b212-b60deb24ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:20.830083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 775/1541] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:20.837145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf890636-614f-4604-bf89-ea1e1a4bfda6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:20.837486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf890636-614f-4604-bf89-ea1e1a4bfda6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:20.837665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf890636-614f-4604-bf89-ea1e1a4bfda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:20.845120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-87166060-a0c1-45e2-916f-69c0eb88f9be None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:20.849059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-87166060-a0c1-45e2-916f-69c0eb88f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:20.871695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-bf890636-614f-4604-bf89-ea1e1a4bfda6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:20.873000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bf890636-614f-4604-bf89-ea1e1a4bfda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:20.873245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 767/1542] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:20.878097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166060-a0c1-45e2-916f-69c0eb88f9be None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:20.887818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 776/1543] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:20.894094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf890636-614f-4604-bf89-ea1e1a4bfda6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:20.897613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166060-a0c1-45e2-916f-69c0eb88f9be None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:20.908338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf890636-614f-4604-bf89-ea1e1a4bfda6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:20.910286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d8cd2-ce68-4f6e-a81c-92177847a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:20.911202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8cd2-ce68-4f6e-a81c-92177847a7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:20.911720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8cd2-ce68-4f6e-a81c-92177847a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:20.912223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d8cd2-ce68-4f6e-a81c-92177847a7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:20.913118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8cd2-ce68-4f6e-a81c-92177847a7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:20.913646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8cd2-ce68-4f6e-a81c-92177847a7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:20.915969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d8cd2-ce68-4f6e-a81c-92177847a7d9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:20.925899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:20.926558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:20.927010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:20.927282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:20.929327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:20.929469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:20.930444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:28:20.930444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 30 19:28:20.930444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: Sep 30 19:28:20.931750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:20.950806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 768/1544] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:28:20.952127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504dfc-f451-4c3a-9a4e-22306ce4e51f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:20.952408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504dfc-f451-4c3a-9a4e-22306ce4e51f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:20.952669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92504dfc-f451-4c3a-9a4e-22306ce4e51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:20.959389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 777/1545] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:20.966096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:20.984554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6ebb-570b-4a22-ba74-e44a61f98a22 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:20.994145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-92504dfc-f451-4c3a-9a4e-22306ce4e51f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:20.994145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-92504dfc-f451-4c3a-9a4e-22306ce4e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.012983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 769/1546] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.014533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7237b-5be0-464e-80c2-90e6fbafd98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.016152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7237b-5be0-464e-80c2-90e6fbafd98a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.016921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7237b-5be0-464e-80c2-90e6fbafd98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.017698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7237b-5be0-464e-80c2-90e6fbafd98a admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.019203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7237b-5be0-464e-80c2-90e6fbafd98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.019516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504dfc-f451-4c3a-9a4e-22306ce4e51f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.022572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7237b-5be0-464e-80c2-90e6fbafd98a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.045518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92504dfc-f451-4c3a-9a4e-22306ce4e51f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.072016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624b360-eb9f-4188-a269-cc451edbe4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.073132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624b360-eb9f-4188-a269-cc451edbe4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.073723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624b360-eb9f-4188-a269-cc451edbe4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.075036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624b360-eb9f-4188-a269-cc451edbe4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.077147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624b360-eb9f-4188-a269-cc451edbe4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.079863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-9624b360-eb9f-4188-a269-cc451edbe4e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:28:21.079863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:28:21.079863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:28:21.081522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624b360-eb9f-4188-a269-cc451edbe4e7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.092871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 778/1547] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:20 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.095044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd4c6-d868-4e2a-965a-9d3b4232da6e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.096066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd4c6-d868-4e2a-965a-9d3b4232da6e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.096660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fd4c6-d868-4e2a-965a-9d3b4232da6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.118241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 770/1548] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.119884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202df3-71ad-4f34-a22b-1e30a238270a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.120410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202df3-71ad-4f34-a22b-1e30a238270a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.121575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58202df3-71ad-4f34-a22b-1e30a238270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.123883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-458fd4c6-d868-4e2a-965a-9d3b4232da6e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.126571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-458fd4c6-d868-4e2a-965a-9d3b4232da6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.147714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-58202df3-71ad-4f34-a22b-1e30a238270a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.147714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-58202df3-71ad-4f34-a22b-1e30a238270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.205926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 779/1549] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.207515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db783ad-2212-40d8-9c2a-1559deb2ea5c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.207794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db783ad-2212-40d8-9c2a-1559deb2ea5c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.208117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db783ad-2212-40d8-9c2a-1559deb2ea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.225770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 771/1550] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.227736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770efa-0fd6-46f6-8578-7c15fdee9738 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.228192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770efa-0fd6-46f6-8578-7c15fdee9738 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.228481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40770efa-0fd6-46f6-8578-7c15fdee9738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.230299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6db783ad-2212-40d8-9c2a-1559deb2ea5c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.231509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6db783ad-2212-40d8-9c2a-1559deb2ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.239653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 780/1551] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.240903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bee0a7-2a58-469d-8892-548d6856d19c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.241182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bee0a7-2a58-469d-8892-548d6856d19c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.241450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bee0a7-2a58-469d-8892-548d6856d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.250303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-40770efa-0fd6-46f6-8578-7c15fdee9738 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.252357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-40770efa-0fd6-46f6-8578-7c15fdee9738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.260778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 772/1552] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.262115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40770efa-0fd6-46f6-8578-7c15fdee9738 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.262434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e5bee0a7-2a58-469d-8892-548d6856d19c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.263713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e5bee0a7-2a58-469d-8892-548d6856d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.271856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40770efa-0fd6-46f6-8578-7c15fdee9738 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.279120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 781/1553] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.279120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bee0a7-2a58-469d-8892-548d6856d19c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.282821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bee0a7-2a58-469d-8892-548d6856d19c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.283072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efedd8-6652-46a9-a6db-779441206192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.283711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efedd8-6652-46a9-a6db-779441206192 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.283988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efedd8-6652-46a9-a6db-779441206192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.284263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efedd8-6652-46a9-a6db-779441206192 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.284887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efedd8-6652-46a9-a6db-779441206192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.286866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13efedd8-6652-46a9-a6db-779441206192 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.287753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ca982-1ef6-4b72-8045-de16f0a6efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.288353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca982-1ef6-4b72-8045-de16f0a6efb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.288634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca982-1ef6-4b72-8045-de16f0a6efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.288905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ca982-1ef6-4b72-8045-de16f0a6efb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.289528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca982-1ef6-4b72-8045-de16f0a6efb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.290577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-122ca982-1ef6-4b72-8045-de16f0a6efb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:28:21.290577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 30 19:28:21.290577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: Sep 30 19:28:21.291811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ca982-1ef6-4b72-8045-de16f0a6efb2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.310466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 773/1554] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/users => generated 295 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.311737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16a8c-c7f2-448c-99fe-cfa7b7ea65bd None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.312029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16a8c-c7f2-448c-99fe-cfa7b7ea65bd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.312292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16a8c-c7f2-448c-99fe-cfa7b7ea65bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.318378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 782/1555] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/users => generated 301 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.318378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbc19-c94e-4eb8-8a5c-59eeee59c74f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.318378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbc19-c94e-4eb8-8a5c-59eeee59c74f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.318378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbc19-c94e-4eb8-8a5c-59eeee59c74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.338165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-61e16a8c-c7f2-448c-99fe-cfa7b7ea65bd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.339304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f54fbc19-c94e-4eb8-8a5c-59eeee59c74f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.339508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-61e16a8c-c7f2-448c-99fe-cfa7b7ea65bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.340668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f54fbc19-c94e-4eb8-8a5c-59eeee59c74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.347296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 774/1556] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.348486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd922a-dff6-4bf0-a46c-9e181b505fe6 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.348891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd922a-dff6-4bf0-a46c-9e181b505fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.349166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd922a-dff6-4bf0-a46c-9e181b505fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.355945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 783/1557] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.355945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fbc19-c94e-4eb8-8a5c-59eeee59c74f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.363630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fbc19-c94e-4eb8-8a5c-59eeee59c74f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.368262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0ee77-8dd2-41d3-a5b3-a8a0f003ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.368859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0ee77-8dd2-41d3-a5b3-a8a0f003ce2e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.369140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0ee77-8dd2-41d3-a5b3-a8a0f003ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.369414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0ee77-8dd2-41d3-a5b3-a8a0f003ce2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.370105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0ee77-8dd2-41d3-a5b3-a8a0f003ce2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:21.370516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0ee77-8dd2-41d3-a5b3-a8a0f003ce2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.372671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0ee77-8dd2-41d3-a5b3-a8a0f003ce2e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.374690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e2bd922a-dff6-4bf0-a46c-9e181b505fe6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.375920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e2bd922a-dff6-4bf0-a46c-9e181b505fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.384087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 775/1558] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.392723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 784/1559] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:21.392909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c1bb9-6c43-4a2c-aa31-a334c7b5f12b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.392909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c1bb9-6c43-4a2c-aa31-a334c7b5f12b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.392909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c1bb9-6c43-4a2c-aa31-a334c7b5f12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.393194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479b9f-e664-4521-9aa4-27308a0f1052 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.393194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479b9f-e664-4521-9aa4-27308a0f1052 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.393194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9479b9f-e664-4521-9aa4-27308a0f1052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.409399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-232c1bb9-6c43-4a2c-aa31-a334c7b5f12b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.410646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-232c1bb9-6c43-4a2c-aa31-a334c7b5f12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.411847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e9479b9f-e664-4521-9aa4-27308a0f1052 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.413028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e9479b9f-e664-4521-9aa4-27308a0f1052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.418596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 776/1560] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.419366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c1bb9-6c43-4a2c-aa31-a334c7b5f12b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.421771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 785/1561] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.423045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9479b9f-e664-4521-9aa4-27308a0f1052 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.429251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c1bb9-6c43-4a2c-aa31-a334c7b5f12b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.432457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9479b9f-e664-4521-9aa4-27308a0f1052 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.434641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3d538-2551-49e0-bd68-cfd974651259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.435318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d538-2551-49e0-bd68-cfd974651259 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.435679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d538-2551-49e0-bd68-cfd974651259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.436018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d538-2551-49e0-bd68-cfd974651259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.436724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3d538-2551-49e0-bd68-cfd974651259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.437890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.438493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3d538-2551-49e0-bd68-cfd974651259 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.438610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.438781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.439056 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.439691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.441267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.449487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 777/1562] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:21.450857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755600-ac3f-47d3-908e-a04c400ee810 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.451330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755600-ac3f-47d3-908e-a04c400ee810 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.451673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4755600-ac3f-47d3-908e-a04c400ee810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.452275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 786/1563] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:21.454974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.464861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69f23-1693-4a5b-92bd-80860c9cff50 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.469428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.470012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.470322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.470598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.471229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:21.471493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d4755600-ac3f-47d3-908e-a04c400ee810 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:21.471652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.472696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d4755600-ac3f-47d3-908e-a04c400ee810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:21.473251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.481364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 778/1564] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:21.487548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755600-ac3f-47d3-908e-a04c400ee810 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.487733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 787/1565] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:21.487733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.492427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4755600-ac3f-47d3-908e-a04c400ee810 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.498495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.499103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.499224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bfda9-572a-420f-b023-d9aa09382ab5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.499377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.499645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.500283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:21.500587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.502724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.504181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.504975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.505703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.505703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.506197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.508087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.514949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 779/1566] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:21.515983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.529555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:21.531486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133110-8c33-4201-baec-9fa59777982a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.537172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 788/1567] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.538042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.538463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.539470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.539985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.540488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.541652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:21.542239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.545397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.557910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 780/1568] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:21.559238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.570257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eaae5-82ac-4746-82e7-60dc8c58a7e8 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.586885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:21.611655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19949a61-20c3-493e-bab4-25d361877152 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.616447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.617052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.617334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.617606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.618295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:21.618597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.620193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.632753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 789/1569] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:21.633563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.638862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.639483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.639762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.640573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.640756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.642382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.644012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35929f-d0fd-44bb-b473-c85cab7ff530 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.648642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.649244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.649525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.649919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.650586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.652767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.653523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 781/1570] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:21.654634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.664201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea14e8-e1b7-4169-ad89-7197578600da admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.668250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 790/1571] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:21.668250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.669717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.670345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.670622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.670892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.671526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:21.671821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.673414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.676036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d5f5-73f7-413f-89a3-c75fdade3098 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.680595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.681180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.681461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.681735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.682481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.684444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.685650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 782/1572] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:21.686553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.697781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867d96e-d240-4ccf-8082-a6643940e6cb admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.703386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.703984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.704287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.704572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.705287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.707222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.715523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 791/1573] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.720544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.739746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 783/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.739746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.784690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d093-2576-4527-95fa-650760ea732b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.800132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df81bb1-76ea-4cba-b065-283b9fc02221 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.804825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.805432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.805711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.805985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.806643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.808790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.837743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 784/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.838399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.842890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.843939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.843939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.844150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.844638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.846617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.862599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:21.870194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 792/1576] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.871912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.881904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ba63a-7786-48c9-95e2-e374b1ba65e0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.904417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efc2b0-3a71-4fc4-b16d-5b53d08d4644 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:21.909570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.910213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.910494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.910762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.911392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.913443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.923583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:21.939832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:21.941135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:21.941420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:21.941696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] PATH_INFO: `/v3/projects/266f949be0924bafbd5d97bd44ce9a30/users/74754bc2aec247f596c7f7317e0dc7e9/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:21.942349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 785/1577] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:21.943263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:21.961231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266f949be0924bafbd5d97bd44ce9a30, user_id=74754bc2aec247f596c7f7317e0dc7e9, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:21.963922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:21.979736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 793/1578] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:21 2022] PUT /identity/v3/projects/266f949be0924bafbd5d97bd44ce9a30/users/74754bc2aec247f596c7f7317e0dc7e9/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:21.985071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.011041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae55817-5733-4a3c-b975-7efdca8796a7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.046684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22cce-cf8e-421a-abc8-990873383c31 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.052425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.053312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.053589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.053905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.054603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.057493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.070072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.070860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.071139 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.071416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] PATH_INFO: `/v3/projects/b27ef18f2ccb457a9ced77b0feb2faf6/users/17ec95037bfe4c39a95f4f1e564ebfb2/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.088192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 794/1579] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:21 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:22.088646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27ef18f2ccb457a9ced77b0feb2faf6, user_id=17ec95037bfe4c39a95f4f1e564ebfb2, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.089927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.090344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:28:22.090344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:28:22.090344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:28:22.092393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.106616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 786/1580] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:21 2022] PUT /identity/v3/projects/b27ef18f2ccb457a9ced77b0feb2faf6/users/17ec95037bfe4c39a95f4f1e564ebfb2/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:22.107410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.154812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9727d67-5e15-46c1-90db-6497ff7d0ab2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.163935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:22.174677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c172d1c-7b61-4539-9c30-c8f77b88f842 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.179338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.179936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.180217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.180486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.181108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.183041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.206189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 787/1581] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:22.207133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.216820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d340f5-4433-4232-aafd-ec514525bec5 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.219603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.220215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.220502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.220768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.221397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.221523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.222001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.222313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.222591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.223202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.223443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.225245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.235059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:22.248098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 795/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:22.248999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.249997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 788/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:22.250761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.260347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354358d6-791b-4723-863f-0f2a28d73a5f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.261129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f615f-d8f2-4ec0-a12c-b9c2b88b6b7e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.265119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe19d83-13ce-47de-ae08-246dc2a887a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.265716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe19d83-13ce-47de-ae08-246dc2a887a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.265997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe19d83-13ce-47de-ae08-246dc2a887a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.266146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.266312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe19d83-13ce-47de-ae08-246dc2a887a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.266741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.266959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe19d83-13ce-47de-ae08-246dc2a887a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.267080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.267298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.267905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.268581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe19d83-13ce-47de-ae08-246dc2a887a5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.269796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.278577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 796/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.279772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e6c8e-2564-4128-bc42-ce00316529ec None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.280065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e6c8e-2564-4128-bc42-ce00316529ec None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.280342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e6c8e-2564-4128-bc42-ce00316529ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.299787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 789/1585] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/users => generated 303 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:22.299787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.300186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0c1e6c8e-2564-4128-bc42-ce00316529ec None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:22.301392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0c1e6c8e-2564-4128-bc42-ce00316529ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:22.307569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab2c3-459d-4097-a337-45acf11ac00c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.309909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 797/1586] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:22.311130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea536530-49cb-4b8c-a96a-1ab62af36685 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.311412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea536530-49cb-4b8c-a96a-1ab62af36685 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.311684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea536530-49cb-4b8c-a96a-1ab62af36685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.313988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.314279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.314565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.314883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.315524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.317786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.341459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ea536530-49cb-4b8c-a96a-1ab62af36685 None None] MFA Rules not processed for user `17ec95037bfe4c39a95f4f1e564ebfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:22.342281 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 790/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/users => generated 301 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:22.345345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ea536530-49cb-4b8c-a96a-1ab62af36685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:22.345452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.352611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1333fb5-5d73-484b-97cc-437e07d2bf18 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.357733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.358354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.358631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.358903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.359568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.361164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.371269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 791/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.372186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.381964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8be8f4-37ee-4e86-b111-2fd3e16f5c18 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.387236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.388037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.388315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.388589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.389225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.390846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.401197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 792/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.402772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.410202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 798/1590] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:22.411151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea536530-49cb-4b8c-a96a-1ab62af36685 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.414236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f90e19-e279-4a63-8cbb-7491877174ec admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.419807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.420580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.420865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.421141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.421766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea536530-49cb-4b8c-a96a-1ab62af36685 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.422100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.423882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.426408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.427001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.427299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.427555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.428186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.429760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.435420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 793/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.436421 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.443138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 799/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.444278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.446167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e066b-979c-4ff5-8e2d-568b9625e780 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.451662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.452255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.452532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.452801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.453428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.455043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.466189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 794/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.466984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.476420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98fb33-4a93-443e-8ed8-7b479c5189d7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.481737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.482343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.482622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.482896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.483515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.485078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.495111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 795/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.496045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.505588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad633c2-fc31-46f1-ac60-a6379c37dfdd admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.507585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60f29-2216-4a57-846a-ad937cc54fcb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.510195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.510773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.511049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.511787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.511907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.512477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.512762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.512859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.513040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.514395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.522321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.523746 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.524410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 796/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.528519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.534624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 800/1596] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:22.535422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.535820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf730d-2de9-4dc0-aaa3-7c7c3b2abde6 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.540597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.541426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.541426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.541740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.542492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.544689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.546039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8d5b-e299-444e-a5e7-8b5faf7b5314 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.550866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.551441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.551781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.552004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.552633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.554566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.556144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 797/1597] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.560303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:22.561384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.574421 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae475349-622e-40ec-af86-33b371d4ce07 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.582519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.583126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.583410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.583684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.584354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.586260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.597012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 801/1598] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:22.597012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.602127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 798/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.602127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.611167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da85b55-1dec-46a2-9212-cdcbbaf4c46b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.671613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b778be-334c-4c9a-9477-5806aa8eb195 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.676773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.677086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.677686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.677810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.677992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.678284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.678420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.678736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] PATH_INFO: `/v3/projects/b31689c5d1f44d798f5add324c9e0759/users/a5fadc5149a94c71a036fde636d596b1/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.679007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.680628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.694211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 799/1600] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.695081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.700931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31689c5d1f44d798f5add324c9e0759, user_id=a5fadc5149a94c71a036fde636d596b1, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.705128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.707204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9475215-7372-42db-8901-939db998a5c0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.713017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.713652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.713935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.714260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.715371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.717235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.728552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 800/1602] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:22.729198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 802/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:22 2022] PUT /identity/v3/projects/b31689c5d1f44d798f5add324c9e0759/users/a5fadc5149a94c71a036fde636d596b1/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:22.729519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.730963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.740305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7fcb4-3b02-4544-ad55-2dd7af206210 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.750039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:22.808848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.809708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.809934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.810356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] PATH_INFO: `/v3/projects/16bc6a44e41846ecaa70b7d051973f21/users/bd4d957239e1473abbe1b8e2b2fce104/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.815903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c624c06-64be-46c7-b5f3-2f2d9401660e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.826024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bc6a44e41846ecaa70b7d051973f21, user_id=bd4d957239e1473abbe1b8e2b2fce104, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.829075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.833605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.834499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.835084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.835598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] PATH_INFO: `/v3/projects/93948007457f4dddb857bacfae09487f/users/a9f6c370e7844ca08d319c27891d4df7/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.847166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 801/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:22 2022] PUT /identity/v3/projects/16bc6a44e41846ecaa70b7d051973f21/users/bd4d957239e1473abbe1b8e2b2fce104/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:22.848307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.861955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93948007457f4dddb857bacfae09487f, user_id=a9f6c370e7844ca08d319c27891d4df7, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.865226 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:22.881660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 803/1604] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:22 2022] PUT /identity/v3/projects/93948007457f4dddb857bacfae09487f/users/a9f6c370e7844ca08d319c27891d4df7/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:22.882958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:22.936484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0bb89-2db6-4e2d-bfb6-ffdfc200bb71 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.939233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:22.957654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac5d48-8b6f-42c3-a784-9e6c902cf374 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:22.964293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:22.966032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:22.966451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:22.966835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] PATH_INFO: `/v3/projects/45abf5a3455c4a2a8ffbbd5499c97181/users/b4522da7ad4f4620b27e0c0006c520d0/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:22.984351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45abf5a3455c4a2a8ffbbd5499c97181, user_id=b4522da7ad4f4620b27e0c0006c520d0, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:22.987504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.000572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c05ab-e8fe-43e8-8627-137eb5c051ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.001186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c05ab-e8fe-43e8-8627-137eb5c051ac admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.001464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c05ab-e8fe-43e8-8627-137eb5c051ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.001734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c05ab-e8fe-43e8-8627-137eb5c051ac admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.002427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c05ab-e8fe-43e8-8627-137eb5c051ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.004451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c05ab-e8fe-43e8-8627-137eb5c051ac admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.007928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 804/1605] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:22 2022] PUT /identity/v3/projects/45abf5a3455c4a2a8ffbbd5499c97181/users/b4522da7ad4f4620b27e0c0006c520d0/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:23.008220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.033348 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 802/1606] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:22 2022] POST /identity/v3/users => generated 309 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:23.035070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d03d9-5c10-4284-9657-54f982a2d57d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.035536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d03d9-5c10-4284-9657-54f982a2d57d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.036795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d03d9-5c10-4284-9657-54f982a2d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.063806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b13d03d9-5c10-4284-9657-54f982a2d57d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:23.065458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b13d03d9-5c10-4284-9657-54f982a2d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:23.100852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:23.110472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee15ea-7b23-4a0e-bd45-e0c5278d1a35 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.116631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f865b5-2453-44a1-8036-3f63a257e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.117388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f865b5-2453-44a1-8036-3f63a257e49e admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.117753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f865b5-2453-44a1-8036-3f63a257e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.118119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f865b5-2453-44a1-8036-3f63a257e49e admin admin] PATH_INFO: `/v3/projects/a676689c3e1b48b5ba946a8cb1b8b452/users/faec3eb3dc5243be813d29bc65b1bcf0/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.139497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f865b5-2453-44a1-8036-3f63a257e49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a676689c3e1b48b5ba946a8cb1b8b452, user_id=faec3eb3dc5243be813d29bc65b1bcf0, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.143234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f865b5-2453-44a1-8036-3f63a257e49e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.147837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 803/1607] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:23.148610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d03d9-5c10-4284-9657-54f982a2d57d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.159163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 805/1608] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:23 2022] PUT /identity/v3/projects/a676689c3e1b48b5ba946a8cb1b8b452/users/faec3eb3dc5243be813d29bc65b1bcf0/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:23.163388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea03b-8958-4092-a974-1f1952b7d9d7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.163675 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea03b-8958-4092-a974-1f1952b7d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.163951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ea03b-8958-4092-a974-1f1952b7d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.172021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d03d9-5c10-4284-9657-54f982a2d57d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.187643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-366ea03b-8958-4092-a974-1f1952b7d9d7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:23.188858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-366ea03b-8958-4092-a974-1f1952b7d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:23.246296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaf609-3168-472b-b799-62ad08307ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.246958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaf609-3168-472b-b799-62ad08307ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.247233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaf609-3168-472b-b799-62ad08307ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.247570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaf609-3168-472b-b799-62ad08307ac8 admin admin] PATH_INFO: `/v3/projects/cf8186217b12470aae9654f21d142a71/users/882fee22e0f54edbb4ff68130117b273/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.260237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 806/1609] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:23.261676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a3ab-f562-48b1-abda-72f87392e11c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.262135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a3ab-f562-48b1-abda-72f87392e11c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.262494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2a3ab-f562-48b1-abda-72f87392e11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.267270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaf609-3168-472b-b799-62ad08307ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8186217b12470aae9654f21d142a71, user_id=882fee22e0f54edbb4ff68130117b273, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.270190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaf609-3168-472b-b799-62ad08307ac8 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.285809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 804/1610] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:23 2022] PUT /identity/v3/projects/cf8186217b12470aae9654f21d142a71/users/882fee22e0f54edbb4ff68130117b273/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:23.287476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabe76-53b9-40e9-9858-ee056f8a4120 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.287765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabe76-53b9-40e9-9858-ee056f8a4120 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.288045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabe76-53b9-40e9-9858-ee056f8a4120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.294082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-65c2a3ab-f562-48b1-abda-72f87392e11c None None] MFA Rules not processed for user `a9f6c370e7844ca08d319c27891d4df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:23.295470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-65c2a3ab-f562-48b1-abda-72f87392e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:23.308882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-23fabe76-53b9-40e9-9858-ee056f8a4120 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:23.310343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-23fabe76-53b9-40e9-9858-ee056f8a4120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:23.348190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:23.378122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 807/1611] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:23.382874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 805/1612] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:23.384804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabe76-53b9-40e9-9858-ee056f8a4120 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.386726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2a3ab-f562-48b1-abda-72f87392e11c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.395818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabe76-53b9-40e9-9858-ee056f8a4120 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.403451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047305b3-bd3d-44b9-90aa-3a3c6a3b47a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.404082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047305b3-bd3d-44b9-90aa-3a3c6a3b47a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.404340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047305b3-bd3d-44b9-90aa-3a3c6a3b47a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.404653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047305b3-bd3d-44b9-90aa-3a3c6a3b47a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.405309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047305b3-bd3d-44b9-90aa-3a3c6a3b47a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.407031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047305b3-bd3d-44b9-90aa-3a3c6a3b47a4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.422512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 806/1613] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:23.424064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bfb7-b352-4a4f-813e-4a34acac311b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.424360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bfb7-b352-4a4f-813e-4a34acac311b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.424639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378bfb7-b352-4a4f-813e-4a34acac311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.454522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b378bfb7-b352-4a4f-813e-4a34acac311b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:23.456028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b378bfb7-b352-4a4f-813e-4a34acac311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:23.466170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 807/1614] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:23.466881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378bfb7-b352-4a4f-813e-4a34acac311b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.484984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2a3ab-f562-48b1-abda-72f87392e11c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.490079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc3caf-ca2a-40cf-8aee-0325f68d8e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.491209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc3caf-ca2a-40cf-8aee-0325f68d8e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.491704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc3caf-ca2a-40cf-8aee-0325f68d8e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.492159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc3caf-ca2a-40cf-8aee-0325f68d8e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.507055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc3caf-ca2a-40cf-8aee-0325f68d8e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.509340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc3caf-ca2a-40cf-8aee-0325f68d8e05 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.522083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 808/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:23.523085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:23.524486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dee49b-a72a-45b6-9f89-ccc90e97a733 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.524939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dee49b-a72a-45b6-9f89-ccc90e97a733 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.525392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dee49b-a72a-45b6-9f89-ccc90e97a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.539933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378bfb7-b352-4a4f-813e-4a34acac311b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.547026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.547717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.548677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.548957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.560327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-41dee49b-a72a-45b6-9f89-ccc90e97a733 None None] MFA Rules not processed for user `882fee22e0f54edbb4ff68130117b273`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:23.561318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-41dee49b-a72a-45b6-9f89-ccc90e97a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:23.563491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.565923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.581819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 808/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:23.582798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.596166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e64c0-1e57-4ac2-89f9-110b767259e0 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.601629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.602809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.602809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.603076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.629331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.630970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.644712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 809/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:23.646687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.653828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 809/1618] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:23.655584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53cd77-77a5-4480-aae8-fb13784ef984 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.656105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53cd77-77a5-4480-aae8-fb13784ef984 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.656608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53cd77-77a5-4480-aae8-fb13784ef984 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.664976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1831d58-b692-4f10-a170-72b4dc6b5e7d service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.665599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 810/1619] 10.222.0.18 () {54 vars in 961 bytes} [Fri Sep 30 19:28:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:28:23.666763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53cd77-77a5-4480-aae8-fb13784ef984 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.673527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408922-f154-46aa-846e-b535f0062c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.674810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408922-f154-46aa-846e-b535f0062c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.675215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408922-f154-46aa-846e-b535f0062c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.675695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408922-f154-46aa-846e-b535f0062c8c admin admin] PATH_INFO: `/v3/projects/1d5b6a3cb6d347459eb2dc7b29b31758/users/e683af87fbcd42788bd15477baffea46/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.681561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53cd77-77a5-4480-aae8-fb13784ef984 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.686935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.687795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.688284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.688907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.703288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.704479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408922-f154-46aa-846e-b535f0062c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5b6a3cb6d347459eb2dc7b29b31758, user_id=e683af87fbcd42788bd15477baffea46, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.706550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.709076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408922-f154-46aa-846e-b535f0062c8c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.722465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 811/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:23.723808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.731572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 810/1621] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:23 2022] PUT /identity/v3/projects/1d5b6a3cb6d347459eb2dc7b29b31758/users/e683af87fbcd42788bd15477baffea46/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:23.736086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab91d-6f10-4fab-9848-138a2d582ad4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.736377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab91d-6f10-4fab-9848-138a2d582ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.736732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab91d-6f10-4fab-9848-138a2d582ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.738748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b0fec-77d5-4e61-913a-09c473461615 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.803100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2c3ab91d-6f10-4fab-9848-138a2d582ad4 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:23.804697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2c3ab91d-6f10-4fab-9848-138a2d582ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:23.820458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.821308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.821843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.822322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.823094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.826670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.843868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:23.866511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 812/1622] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/projects => generated 399 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:23.867549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.921196 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 811/1623] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:23.922274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab91d-6f10-4fab-9848-138a2d582ad4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:23.939756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab91d-6f10-4fab-9848-138a2d582ad4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.963170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb00356-1d55-4704-a8fc-1cbaf2ff5260 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:23.971747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:23.973388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:23.973687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:23.973981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:23.974848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:23.976593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:23.993772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 813/1624] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:23.994866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.038494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.039120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.039403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.039732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.040370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.043099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.072690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 812/1625] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:23 2022] POST /identity/v3/users => generated 306 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:24.074132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.085419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5486d5-81dd-4f08-a9af-0a895eed9c84 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.091252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.091970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.092249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.092529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] PATH_INFO: `/v3/projects/1d5b6a3cb6d347459eb2dc7b29b31758/users/e683af87fbcd42788bd15477baffea46/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.094499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5b6a3cb6d347459eb2dc7b29b31758, user_id=e683af87fbcd42788bd15477baffea46, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.097277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.105587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:24.113910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 813/1626] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:24 2022] PUT /identity/v3/projects/1d5b6a3cb6d347459eb2dc7b29b31758/users/e683af87fbcd42788bd15477baffea46/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:24.115010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.126274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1336e-4512-42b1-90b5-7f179b6e9e0c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.212277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68608f3-e3ed-45cd-8363-1e7333028acf admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.218892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe92efc-f340-41ba-8842-d79d58b7b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.219776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92efc-f340-41ba-8842-d79d58b7b710 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.220065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92efc-f340-41ba-8842-d79d58b7b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.220437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe92efc-f340-41ba-8842-d79d58b7b710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.221194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe92efc-f340-41ba-8842-d79d58b7b710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.223097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe92efc-f340-41ba-8842-d79d58b7b710 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.234512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.235428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.235882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.236812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.238014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 814/1627] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:24.242848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc830e5-5c2e-4dff-8024-105d069d948e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.243371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc830e5-5c2e-4dff-8024-105d069d948e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.243768 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc830e5-5c2e-4dff-8024-105d069d948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.291749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1bc830e5-5c2e-4dff-8024-105d069d948e None None] MFA Rules not processed for user `e683af87fbcd42788bd15477baffea46`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:24.293904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1bc830e5-5c2e-4dff-8024-105d069d948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:24.298023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:24.359039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.360581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.386775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 814/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:24.387813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.406698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f39261-3834-452a-9d60-5248b19bfd6c service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.413928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.415073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.415362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.415689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] PATH_INFO: `/v3/projects/d499804e1d094bb387fd831b59069aff/users/49648f8c52124d9aa3270786199cacd1/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.424637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 815/1629] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:24.435617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d499804e1d094bb387fd831b59069aff, user_id=49648f8c52124d9aa3270786199cacd1, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.438229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc830e5-5c2e-4dff-8024-105d069d948e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.438442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.483604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 815/1630] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:24 2022] PUT /identity/v3/projects/d499804e1d094bb387fd831b59069aff/users/49648f8c52124d9aa3270786199cacd1/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:24.487477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.535456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc830e5-5c2e-4dff-8024-105d069d948e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.597866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d0563-941c-4837-9d7e-1fe332af09e6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.606497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.606497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.606497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.606497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.607281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.609092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.619500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:24.707340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 816/1631] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:24.707340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.707340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db3cd-cec5-4e86-a227-e352b82fc0a8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.708083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1c4de-db58-4cf2-85d8-1db76e2fd81b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.708083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c4de-db58-4cf2-85d8-1db76e2fd81b service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.708083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c4de-db58-4cf2-85d8-1db76e2fd81b service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.708083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c4de-db58-4cf2-85d8-1db76e2fd81b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.708502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3338fc0-8505-4b9e-bca4-4f7196a30ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.708502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338fc0-8505-4b9e-bca4-4f7196a30ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.708502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338fc0-8505-4b9e-bca4-4f7196a30ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.708502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338fc0-8505-4b9e-bca4-4f7196a30ba7 admin admin] PATH_INFO: `/v3/projects/d499804e1d094bb387fd831b59069aff/users/49648f8c52124d9aa3270786199cacd1/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.708800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3338fc0-8505-4b9e-bca4-4f7196a30ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d499804e1d094bb387fd831b59069aff, user_id=49648f8c52124d9aa3270786199cacd1, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.708800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3338fc0-8505-4b9e-bca4-4f7196a30ba7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.708800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 817/1632] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:24 2022] PUT /identity/v3/projects/d499804e1d094bb387fd831b59069aff/users/49648f8c52124d9aa3270786199cacd1/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:24.712436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090382-9cda-4fcb-aae5-95ec5d22b503 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.712611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090382-9cda-4fcb-aae5-95ec5d22b503 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.712802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5090382-9cda-4fcb-aae5-95ec5d22b503 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.715452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 818/1633] 10.222.0.18 () {54 vars in 912 bytes} [Fri Sep 30 19:28:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:28:24.717416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a1b76-8a19-45b5-aa13-4b7e27e589da None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.717536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a1b76-8a19-45b5-aa13-4b7e27e589da None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.717834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a1b76-8a19-45b5-aa13-4b7e27e589da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.774860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a19a1b76-8a19-45b5-aa13-4b7e27e589da None None] MFA Rules not processed for user `49648f8c52124d9aa3270786199cacd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:24.776227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a19a1b76-8a19-45b5-aa13-4b7e27e589da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:24.787657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1c4de-db58-4cf2-85d8-1db76e2fd81b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:24.789385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf1c4de-db58-4cf2-85d8-1db76e2fd81b service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:24.810399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 816/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:24 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:24.812598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5e8c0-a776-4cd9-8533-a3588cae9170 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:24.812939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5e8c0-a776-4cd9-8533-a3588cae9170 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:24.813224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5e8c0-a776-4cd9-8533-a3588cae9170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:24.842585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4fe5e8c0-a776-4cd9-8533-a3588cae9170 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:24.844534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4fe5e8c0-a776-4cd9-8533-a3588cae9170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:24.883152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 819/1635] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:24.897149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a1b76-8a19-45b5-aa13-4b7e27e589da None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:24.907314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:24.986192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 817/1636] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:24.994459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a1b76-8a19-45b5-aa13-4b7e27e589da None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:24.999233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:24.999865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:25.000151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:25.000428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:25.013373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:25.023804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:25.036070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5e8c0-a776-4cd9-8533-a3588cae9170 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:25.039680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 820/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:28:25.052901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5e8c0-a776-4cd9-8533-a3588cae9170 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:25.056851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:25.057719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:25.058765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:25.059446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:25.072729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:25.075292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:25.097235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 818/1638] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:28:25.218676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:25.285745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:25.305795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1e560-99ef-4aad-ad5e-5898d23f19b4 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:25.310859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2266f1b-5678-4524-b52d-310f93ee9bea service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:25.329889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aba5de-fa1b-455e-b0d7-76199d26dd41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:25.330802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba5de-fa1b-455e-b0d7-76199d26dd41 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:25.331270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba5de-fa1b-455e-b0d7-76199d26dd41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:25.331781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:25.332431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aba5de-fa1b-455e-b0d7-76199d26dd41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:25.332864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:25.333986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:25.333986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] PATH_INFO: `/v3/users/17ec95037bfe4c39a95f4f1e564ebfb2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:25.339791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ec95037bfe4c39a95f4f1e564ebfb2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:25.341778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:25.450625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ec95037bfe4c39a95f4f1e564ebfb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:25.451523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ec95037bfe4c39a95f4f1e564ebfb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:25.453164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ec95037bfe4c39a95f4f1e564ebfb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:25.459191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba5de-fa1b-455e-b0d7-76199d26dd41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:25.462772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aba5de-fa1b-455e-b0d7-76199d26dd41 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:25.469512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ec95037bfe4c39a95f4f1e564ebfb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:25.485653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ec95037bfe4c39a95f4f1e564ebfb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:25.520236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 819/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:25.561659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a21bd-36e5-432f-b804-f50d05ce2453 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:25.561951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a21bd-36e5-432f-b804-f50d05ce2453 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:25.562332 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a21bd-36e5-432f-b804-f50d05ce2453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:25.565258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 821/1640] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:25 2022] DELETE /identity/v3/users/17ec95037bfe4c39a95f4f1e564ebfb2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:25.572423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:25.605970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b57a21bd-36e5-432f-b804-f50d05ce2453 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:25.607232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b57a21bd-36e5-432f-b804-f50d05ce2453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:25.761316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 820/1641] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:25.866960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:25.868764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:25.939910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:25.958620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126e35-e688-4ed4-9807-3713e4b83636 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:25.958905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126e35-e688-4ed4-9807-3713e4b83636 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:25.959234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126e35-e688-4ed4-9807-3713e4b83636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.025462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e13c5-c42a-4386-9de6-ec7c5db98047 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:26.034801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:26.035430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.035770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.036041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.036152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ff126e35-e688-4ed4-9807-3713e4b83636 None None] MFA Rules not processed for user `faec3eb3dc5243be813d29bc65b1bcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:26.037384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ff126e35-e688-4ed4-9807-3713e4b83636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:26.062704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:26.068963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:26.094459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 822/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:26.188717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 821/1643] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:26.192989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:26.194457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:26.213227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a2491-c17e-4faf-a7d8-c19a57a7dc53 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:26.219358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:26.220238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.220718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.221211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.222078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:26.224197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:26.274475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 823/1644] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:26 2022] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:26.279188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126e35-e688-4ed4-9807-3713e4b83636 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:26.297974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126e35-e688-4ed4-9807-3713e4b83636 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:26.451926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:26.452673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.452959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.453231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.453881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:26.456027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:26.497674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 822/1645] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:26 2022] POST /identity/v3/users => generated 308 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:26.503035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:26.520327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddda6bc-998b-49cd-b4c5-875133bf3ffa admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:26.536583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:26.538495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.539347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.540237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.541440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:26.547202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:26.596909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:26.602166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 824/1646] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:26.616088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cd80c-daaf-412b-8782-9fb46340d907 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:26.633941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b1da2-c60d-4afe-83a7-a14466977547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:26.636745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1da2-c60d-4afe-83a7-a14466977547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.638870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1da2-c60d-4afe-83a7-a14466977547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.639400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b1da2-c60d-4afe-83a7-a14466977547 admin admin] PATH_INFO: `/v3/projects/356d05b27a3b415a96908b3cc492b2be/users/d81a50553c3a4c6d9660db92d4bbd217/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.681464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b1da2-c60d-4afe-83a7-a14466977547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356d05b27a3b415a96908b3cc492b2be, user_id=d81a50553c3a4c6d9660db92d4bbd217, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:26.686142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b1da2-c60d-4afe-83a7-a14466977547 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:26.708211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:26.723894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 823/1647] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:26 2022] PUT /identity/v3/projects/356d05b27a3b415a96908b3cc492b2be/users/d81a50553c3a4c6d9660db92d4bbd217/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:28:26.725330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:26.732456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614dc72-4371-4cda-8dcc-50e9bc9d222a None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.732687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614dc72-4371-4cda-8dcc-50e9bc9d222a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.732931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614dc72-4371-4cda-8dcc-50e9bc9d222a None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.736805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 824/1648] 10.222.0.18 () {54 vars in 961 bytes} [Fri Sep 30 19:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:28:26.749621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672795-aac0-4f12-ba45-c581239e5dfc None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.749939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672795-aac0-4f12-ba45-c581239e5dfc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.750772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa672795-aac0-4f12-ba45-c581239e5dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.755423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c849b-89dc-4d72-986d-b12dd387cbc6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:26.797506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-aa672795-aac0-4f12-ba45-c581239e5dfc None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:26.798792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-aa672795-aac0-4f12-ba45-c581239e5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:26.908549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:26.909262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:26.909711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:26.910152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:26.911150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:26.913141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:26.951608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 825/1649] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:26.951608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:26.953158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:26.978252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 825/1650] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Sep 30 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:26.980599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa672795-aac0-4f12-ba45-c581239e5dfc None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:26.999037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d45c9-4d86-4f41-adbd-59dfac9ff4d9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:27.000363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa672795-aac0-4f12-ba45-c581239e5dfc None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:27.007240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525b798-9bd4-409a-afba-6a167739b4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:27.008647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b798-9bd4-409a-afba-6a167739b4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:27.009643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b798-9bd4-409a-afba-6a167739b4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:27.010090 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525b798-9bd4-409a-afba-6a167739b4a5 admin admin] PATH_INFO: `/v3/projects/356d05b27a3b415a96908b3cc492b2be/users/d81a50553c3a4c6d9660db92d4bbd217/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:27.015542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b798-9bd4-409a-afba-6a167739b4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356d05b27a3b415a96908b3cc492b2be, user_id=d81a50553c3a4c6d9660db92d4bbd217, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:27.016430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:27.017191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:27.017347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:27.068225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] PATH_INFO: `/v3/projects/b27ef18f2ccb457a9ced77b0feb2faf6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:27.068225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27ef18f2ccb457a9ced77b0feb2faf6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:27.076832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525b798-9bd4-409a-afba-6a167739b4a5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:27.081731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:28:27.081731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 30 19:28:27.081731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: Sep 30 19:28:27.081731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:27.082009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 826/1651] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:26 2022] PUT /identity/v3/projects/356d05b27a3b415a96908b3cc492b2be/users/d81a50553c3a4c6d9660db92d4bbd217/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:27.082009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda16d-691f-4e0a-8ee0-848e07d85320 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:27.082009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda16d-691f-4e0a-8ee0-848e07d85320 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:27.082009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbda16d-691f-4e0a-8ee0-848e07d85320 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:27.082009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 827/1652] 10.222.0.18 () {54 vars in 912 bytes} [Fri Sep 30 19:28:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:28:27.082009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:27.083037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:27.083037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:27.107240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:27.108566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:27.201050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27ef18f2ccb457a9ced77b0feb2faf6', 'request_id': 'req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.234696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27ef18f2ccb457a9ced77b0feb2faf6', 'request_id': 'req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.271435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27ef18f2ccb457a9ced77b0feb2faf6', 'request_id': 'req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.302954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 828/1653] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:27.315395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:27.317074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:27.319859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] The token cache is being invalidate because project b27ef18f2ccb457a9ced77b0feb2faf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:27.320268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.321479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.325888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 826/1654] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:26 2022] DELETE /identity/v3/projects/b27ef18f2ccb457a9ced77b0feb2faf6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:27.341678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:27.343936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:27.381191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:27.454646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad23cbc-185a-493c-bec1-ccd515520530 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:27.515129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:27.538565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf8028-e3ec-47e9-812c-07ff10cd80f8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:27.553444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:27.554423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:27.555344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:27.556167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] PATH_INFO: `/v3/users/e683af87fbcd42788bd15477baffea46` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:27.559529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e683af87fbcd42788bd15477baffea46)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:27.568429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:27.589837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a50fea-a0fe-44d3-98b3-4a4e77bad0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:27.590513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a50fea-a0fe-44d3-98b3-4a4e77bad0aa service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:27.590794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a50fea-a0fe-44d3-98b3-4a4e77bad0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:27.591313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a50fea-a0fe-44d3-98b3-4a4e77bad0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:27.596717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-96a50fea-a0fe-44d3-98b3-4a4e77bad0aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:27.697574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e683af87fbcd42788bd15477baffea46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.701798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e683af87fbcd42788bd15477baffea46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.706661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e683af87fbcd42788bd15477baffea46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.725690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e683af87fbcd42788bd15477baffea46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.739417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e683af87fbcd42788bd15477baffea46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:27.770920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 827/1655] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:27 2022] DELETE /identity/v3/users/e683af87fbcd42788bd15477baffea46 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:27.771876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a50fea-a0fe-44d3-98b3-4a4e77bad0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:27.773387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a50fea-a0fe-44d3-98b3-4a4e77bad0aa service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:27.802735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 829/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:28:29.157192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:29.161261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:29.369547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2536d-8f02-4055-8e93-a19fb57a47ef admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:29.381094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:29.381753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:29.382083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:29.382395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] PATH_INFO: `/v3/projects/1d5b6a3cb6d347459eb2dc7b29b31758` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:29.383715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5b6a3cb6d347459eb2dc7b29b31758)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:29.386887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:29.470010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:29.494218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5b6a3cb6d347459eb2dc7b29b31758', 'request_id': 'req-5d741a5b-797b-4b10-be1d-641168c684c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:29.508542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5b6a3cb6d347459eb2dc7b29b31758', 'request_id': 'req-5d741a5b-797b-4b10-be1d-641168c684c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:29.524497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5b6a3cb6d347459eb2dc7b29b31758', 'request_id': 'req-5d741a5b-797b-4b10-be1d-641168c684c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:29.549201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] The token cache is being invalidate because project 1d5b6a3cb6d347459eb2dc7b29b31758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:29.550950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:29.552422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5d741a5b-797b-4b10-be1d-641168c684c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:29.560659 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 828/1657] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:29 2022] DELETE /identity/v3/projects/1d5b6a3cb6d347459eb2dc7b29b31758 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:29.562374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ccc0-e8dd-418e-80e5-27140946b22d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:29.562839 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ccc0-e8dd-418e-80e5-27140946b22d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:29.562905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ccc0-e8dd-418e-80e5-27140946b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:29.615165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b710ccc0-e8dd-418e-80e5-27140946b22d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:29.616971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b710ccc0-e8dd-418e-80e5-27140946b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:29.662891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c992-c5c6-4524-bf80-db413e95959b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:29.663664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c992-c5c6-4524-bf80-db413e95959b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:29.663951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7c992-c5c6-4524-bf80-db413e95959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:29.778592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-58b7c992-c5c6-4524-bf80-db413e95959b None None] MFA Rules not processed for user `d81a50553c3a4c6d9660db92d4bbd217`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:29.780076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-58b7c992-c5c6-4524-bf80-db413e95959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:29.860310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 830/1658] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:29.869351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7485a08-d00e-4850-b431-3e5b193edd7c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:29.869891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7485a08-d00e-4850-b431-3e5b193edd7c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:29.870871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7485a08-d00e-4850-b431-3e5b193edd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:29.957935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 829/1659] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:29.962905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d7485a08-d00e-4850-b431-3e5b193edd7c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:29.964946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d7485a08-d00e-4850-b431-3e5b193edd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:29.991970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 831/1660] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:29.993371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7c992-c5c6-4524-bf80-db413e95959b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:30.008570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7c992-c5c6-4524-bf80-db413e95959b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:30.022992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:30.023944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.024308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.025284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.026899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:30.030764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:30.032310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:30.063839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 830/1661] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:30.071278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7485a08-d00e-4850-b431-3e5b193edd7c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:30.087591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7485a08-d00e-4850-b431-3e5b193edd7c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:30.107038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:30.108084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.108701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.109187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.110033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:30.112354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:30.179591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 832/1662] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:30 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:30.181166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:30.209688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e44422-c65c-4bed-8d79-878b4f361694 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:30.330395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:30.331254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.331540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.331816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.332627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:30.335988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:30.379048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:30.379911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 831/1663] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:30 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:30.394429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64af4df-fe13-4bc6-988f-049da525fc0e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:30.400625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:30.402671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.403503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.403795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.404556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:30.406561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:30.444170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:30.455936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 833/1664] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:30.458372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9a5b7-a309-41d1-8f56-c178f32360fa admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:30.468124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f56e0-a03e-48d1-a3f4-267a309816de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:30.468872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f56e0-a03e-48d1-a3f4-267a309816de admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.469666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f56e0-a03e-48d1-a3f4-267a309816de admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.470155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f56e0-a03e-48d1-a3f4-267a309816de admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.470907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f56e0-a03e-48d1-a3f4-267a309816de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:30.475725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f56e0-a03e-48d1-a3f4-267a309816de admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:30.495441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:30.503196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 832/1665] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:30.509062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d679fb0e-ac5d-46ac-aef4-491a79f57745 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:30.521067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:30.522085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.522431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.522763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] PATH_INFO: `/v3/projects/f16bca58f2fe4462a9c33d56dfac6b05/users/20f8a3ed6c9c45448f6e9754775052a5/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.549785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16bca58f2fe4462a9c33d56dfac6b05, user_id=20f8a3ed6c9c45448f6e9754775052a5, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:30.553408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:30.588581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 834/1666] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:30 2022] PUT /identity/v3/projects/f16bca58f2fe4462a9c33d56dfac6b05/users/20f8a3ed6c9c45448f6e9754775052a5/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:30.600993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456a17-e8cc-4853-a30d-6b399b16985f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.601289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456a17-e8cc-4853-a30d-6b399b16985f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.601573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456a17-e8cc-4853-a30d-6b399b16985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.671349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0b456a17-e8cc-4853-a30d-6b399b16985f None None] MFA Rules not processed for user `20f8a3ed6c9c45448f6e9754775052a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:30.672970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0b456a17-e8cc-4853-a30d-6b399b16985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:30.679426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:30.797615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 833/1667] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:30.804367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:30.813477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:30.964465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b4938-99cd-45c0-aa03-580c652ab430 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:30.972758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:30.973865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:30.974380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:30.974799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:30.975726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:30.977968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:31.024493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 835/1668] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:30 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:31.024973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456a17-e8cc-4853-a30d-6b399b16985f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:31.038263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456a17-e8cc-4853-a30d-6b399b16985f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:31.185663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:31.186339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.186628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.186897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.187553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:31.189505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:31.226969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 834/1669] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:31 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:31.228374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:31.240639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429b01d-b8ae-4800-b350-92d0ba526daa admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:31.248884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:31.249848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.250404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.251004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.251992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:31.253824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:31.265941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 836/1670] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:31.270548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:31.285464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3de94-ce93-477a-bbc3-bd0cf0198c2e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:31.293108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:31.293957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.294362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.294741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] PATH_INFO: `/v3/projects/06dae1de1c884404b9c9df5f66fb4b3e/users/98ef97cd1a0d490e98716935289c7110/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.314619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dae1de1c884404b9c9df5f66fb4b3e, user_id=98ef97cd1a0d490e98716935289c7110, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:31.317446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:31.345534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:31.346037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 835/1671] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:31 2022] PUT /identity/v3/projects/06dae1de1c884404b9c9df5f66fb4b3e/users/98ef97cd1a0d490e98716935289c7110/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:28:31.358934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005552c0-dae5-4be9-84f0-5e00dc604379 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:31.464848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb786f-4d2e-4685-86b0-853f2150417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:31.465847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb786f-4d2e-4685-86b0-853f2150417c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.466324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb786f-4d2e-4685-86b0-853f2150417c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.466761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb786f-4d2e-4685-86b0-853f2150417c admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.467557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb786f-4d2e-4685-86b0-853f2150417c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:31.470698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb786f-4d2e-4685-86b0-853f2150417c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:31.499402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 837/1672] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:31.503764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:31.526875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e9f6c-d3f8-4dc7-9bba-291265714f5a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:31.551929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:31.552625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.552911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.553191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] PATH_INFO: `/v3/projects/06dae1de1c884404b9c9df5f66fb4b3e/users/98ef97cd1a0d490e98716935289c7110/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.560492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dae1de1c884404b9c9df5f66fb4b3e, user_id=98ef97cd1a0d490e98716935289c7110, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:31.563229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:31.605538 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bdae1-171c-47f1-a7d9-fe0d83545f55 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.606106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bdae1-171c-47f1-a7d9-fe0d83545f55 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.606106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bdae1-171c-47f1-a7d9-fe0d83545f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.606453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 836/1673] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:31 2022] PUT /identity/v3/projects/06dae1de1c884404b9c9df5f66fb4b3e/users/98ef97cd1a0d490e98716935289c7110/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:31.653615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:31.655731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:31.683015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a23bdae1-171c-47f1-a7d9-fe0d83545f55 None None] MFA Rules not processed for user `98ef97cd1a0d490e98716935289c7110`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:31.684937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a23bdae1-171c-47f1-a7d9-fe0d83545f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:31.742726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c41b-23b0-47fd-8a43-526c56a4f5b0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:31.754029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:31.754773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.755065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.755565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] PATH_INFO: `/v3/users/882fee22e0f54edbb4ff68130117b273` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.757240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=882fee22e0f54edbb4ff68130117b273)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:31.759354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:31.761760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:31.886243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:31.886841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882fee22e0f54edbb4ff68130117b273'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:31.887575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882fee22e0f54edbb4ff68130117b273'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:31.888212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882fee22e0f54edbb4ff68130117b273'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:31.908077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882fee22e0f54edbb4ff68130117b273'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:31.914458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 838/1674] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:31.916073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2e63-d85e-467d-bcbf-c557aaf0be44 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.917952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2e63-d85e-467d-bcbf-c557aaf0be44 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.918434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2e63-d85e-467d-bcbf-c557aaf0be44 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:31.921903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 839/1675] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:28:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:28:31.923072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2e63-d85e-467d-bcbf-c557aaf0be44 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:31.925239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c8ad2e63-d85e-467d-bcbf-c557aaf0be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:31.931424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76fdd0dd-9667-4df0-8099-094895666c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882fee22e0f54edbb4ff68130117b273'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:31.976982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 837/1676] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:31 2022] DELETE /identity/v3/users/882fee22e0f54edbb4ff68130117b273 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:31.979121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a8eb-765b-44d8-8a09-5386d3cc8b02 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:31.979498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a8eb-765b-44d8-8a09-5386d3cc8b02 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:31.979780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a8eb-765b-44d8-8a09-5386d3cc8b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:32.027256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6047a8eb-765b-44d8-8a09-5386d3cc8b02 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:32.031251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6047a8eb-765b-44d8-8a09-5386d3cc8b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:32.067532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2e63-d85e-467d-bcbf-c557aaf0be44 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:32.221308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 838/1677] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:28:32.230851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:32.230851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:32.230851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:32.231128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:32.231530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:32.231983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:32.232433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:32.246558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:32.273924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:32.279567 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:32.468127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:32.469644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:32.493498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 840/1678] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:32.506984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:32.518229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:32.518805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 839/1679] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:32.519676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:32.521002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:32.545510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198e6f5-97f4-4551-9c40-4bf3ddc26e85 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:32.559193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:32.561297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:32.563507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:32.563885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] PATH_INFO: `/v3/users/a9f6c370e7844ca08d319c27891d4df7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:32.568883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f6c370e7844ca08d319c27891d4df7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:32.576534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:32.610179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:32.697537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249c64-ceb2-483c-8ac0-0398bc8e034f service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:32.713051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7350f6-fd2f-4182-a6b9-9d5e7b0b56a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:32.715453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7350f6-fd2f-4182-a6b9-9d5e7b0b56a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:32.715453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7350f6-fd2f-4182-a6b9-9d5e7b0b56a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:32.715453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7350f6-fd2f-4182-a6b9-9d5e7b0b56a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:32.722760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f6c370e7844ca08d319c27891d4df7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:32.723988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f6c370e7844ca08d319c27891d4df7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:32.724662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f6c370e7844ca08d319c27891d4df7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:32.739261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7350f6-fd2f-4182-a6b9-9d5e7b0b56a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:32.741139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f6c370e7844ca08d319c27891d4df7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:32.757871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7350f6-fd2f-4182-a6b9-9d5e7b0b56a0 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:32.759791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f6c370e7844ca08d319c27891d4df7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:32.796349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 841/1680] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:32.813953 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 840/1681] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:32 2022] DELETE /identity/v3/users/a9f6c370e7844ca08d319c27891d4df7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:32.819116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:32.819404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:32.819750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:32.865700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:32.868819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:32.881527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:32.907499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:32.908993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:33.132741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 842/1682] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:33.195483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803bed1-09c9-4d9c-8f98-01729c0d5b1b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:33.203030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:33.203676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:33.203961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:33.204236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:33.214514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:33.237084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:33.238895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:33.273322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:33.278618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:33.306110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 841/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:28:33.524879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab18118-af83-4e76-9847-d43e46aec16d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:33.539209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108303fa-d397-490b-b2ff-729b8dce6603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:33.540340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108303fa-d397-490b-b2ff-729b8dce6603 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:33.540815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108303fa-d397-490b-b2ff-729b8dce6603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:33.541283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108303fa-d397-490b-b2ff-729b8dce6603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:33.563710 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108303fa-d397-490b-b2ff-729b8dce6603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:33.565377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108303fa-d397-490b-b2ff-729b8dce6603 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:33.629884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 843/1684] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:28:33.761305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:33.763838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:33.789786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055c1d3-e3f0-4158-a06e-f28540d009cc service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:33.803150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:33.804919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:33.805387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:33.805823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] PATH_INFO: `/v3/users/20f8a3ed6c9c45448f6e9754775052a5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:33.811039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f8a3ed6c9c45448f6e9754775052a5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:33.813267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:33.919351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f8a3ed6c9c45448f6e9754775052a5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:33.920211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f8a3ed6c9c45448f6e9754775052a5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:33.920948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f8a3ed6c9c45448f6e9754775052a5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:33.937090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f8a3ed6c9c45448f6e9754775052a5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:33.952474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f8a3ed6c9c45448f6e9754775052a5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:33.965876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:33.998945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 842/1685] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:33 2022] DELETE /identity/v3/users/20f8a3ed6c9c45448f6e9754775052a5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:34.000999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:34.001484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:34.001804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:34.033154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:34.034924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:34.146267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 844/1686] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:34.196963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:34.199642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:34.336790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fed63a-3481-459d-9eb7-6a6caae4a0de admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:34.341324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:34.342101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:34.342503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:34.342903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:34.363839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:34.365799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:34.391458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 843/1687] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:35.363493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:35.365721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:35.388781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391a6c4-4957-4537-9771-14efed65c45f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:35.412205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:35.412914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:35.413188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:35.413451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] PATH_INFO: `/v3/users/faec3eb3dc5243be813d29bc65b1bcf0` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:35.421696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faec3eb3dc5243be813d29bc65b1bcf0)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:35.423352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:35.424874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:35.430513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: WARNING py.warnings [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 30 19:28:35.430513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: warnings.warn(msg) Sep 30 19:28:35.430513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: Sep 30 19:28:35.436476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:35.454299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dbe49-13f2-47cb-9587-76261322fc10 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:35.469771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:35.470468 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:35.470741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:35.471021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] PATH_INFO: `/v3/projects/93948007457f4dddb857bacfae09487f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:35.477840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93948007457f4dddb857bacfae09487f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:35.480533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:35.625438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faec3eb3dc5243be813d29bc65b1bcf0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.627719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:35.644575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faec3eb3dc5243be813d29bc65b1bcf0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.645263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faec3eb3dc5243be813d29bc65b1bcf0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.654974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93948007457f4dddb857bacfae09487f', 'request_id': 'req-5c436599-a8fc-499f-94a8-c260866a0858'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.692081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faec3eb3dc5243be813d29bc65b1bcf0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.692706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93948007457f4dddb857bacfae09487f', 'request_id': 'req-5c436599-a8fc-499f-94a8-c260866a0858'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.699746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-48a9a79b-383f-4eb5-bd9e-83fc32072a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faec3eb3dc5243be813d29bc65b1bcf0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.709437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93948007457f4dddb857bacfae09487f', 'request_id': 'req-5c436599-a8fc-499f-94a8-c260866a0858'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.743037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] The token cache is being invalidate because project 93948007457f4dddb857bacfae09487f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:35.743338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.744000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5c436599-a8fc-499f-94a8-c260866a0858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:35.747287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 844/1688] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:35 2022] DELETE /identity/v3/projects/93948007457f4dddb857bacfae09487f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:28:35.752629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946372e6-d43d-4c93-b9e1-68daf6abee16 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:35.760985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946372e6-d43d-4c93-b9e1-68daf6abee16 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:35.761262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946372e6-d43d-4c93-b9e1-68daf6abee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:35.794677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 845/1689] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:35 2022] DELETE /identity/v3/users/faec3eb3dc5243be813d29bc65b1bcf0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:35.828843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-946372e6-d43d-4c93-b9e1-68daf6abee16 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:35.830402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-946372e6-d43d-4c93-b9e1-68daf6abee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:35.936486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 845/1690] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:35.936690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34768-5fb2-4c7a-bc22-665d6d8ec14d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:35.936994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34768-5fb2-4c7a-bc22-665d6d8ec14d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:35.937271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb34768-5fb2-4c7a-bc22-665d6d8ec14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:35.968574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:35.968977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:35.969362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:35.975224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1cb34768-5fb2-4c7a-bc22-665d6d8ec14d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:35.976701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1cb34768-5fb2-4c7a-bc22-665d6d8ec14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:35.993143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 846/1691] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:35.998503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb34768-5fb2-4c7a-bc22-665d6d8ec14d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:36.012211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb34768-5fb2-4c7a-bc22-665d6d8ec14d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:36.020134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:36.021162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:36.021581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:36.022020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:36.023758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:36.024216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:36.026776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:36.040629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] MFA Rules not processed for user `74754bc2aec247f596c7f7317e0dc7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:36.043836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:36.047789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 847/1692] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:36.079297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:36.098474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:36.131390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466adc-7b3e-4c68-b83e-58568acb0bca admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:36.180051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:36.180936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:36.190077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:36.190836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:36.193968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:36.196509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:36.267068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 848/1693] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:36 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:36.269052 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:36.271423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:36.329555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 846/1694] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:36.329555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:36.343605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:36.371737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf3dde-9074-4720-bb40-c7a706d1a011 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:36.441457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba2d1-218a-492e-b4cf-ca8c53b4d579 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:36.459911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:36.461226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:36.461715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:36.462238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] PATH_INFO: `/v3/projects/f16bca58f2fe4462a9c33d56dfac6b05` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:36.465888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16bca58f2fe4462a9c33d56dfac6b05)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:36.471172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:36.481191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:36.482081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:36.482352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:36.482595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] PATH_INFO: `/v3/projects/cf8186217b12470aae9654f21d142a71` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:36.484272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8186217b12470aae9654f21d142a71)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:36.486274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:36.563949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8186217b12470aae9654f21d142a71', 'request_id': 'req-f0f34c41-2d30-4363-865b-6c0e93c74079'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.577050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8186217b12470aae9654f21d142a71', 'request_id': 'req-f0f34c41-2d30-4363-865b-6c0e93c74079'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.598534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8186217b12470aae9654f21d142a71', 'request_id': 'req-f0f34c41-2d30-4363-865b-6c0e93c74079'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.620826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16bca58f2fe4462a9c33d56dfac6b05', 'request_id': 'req-7fa6f996-3231-4098-948a-586b559a9e45'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.631480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] The token cache is being invalidate because project cf8186217b12470aae9654f21d142a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:36.631480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.632746 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.638509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 847/1695] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:36 2022] DELETE /identity/v3/projects/cf8186217b12470aae9654f21d142a71 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:36.639470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:36.641117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:36.642375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16bca58f2fe4462a9c33d56dfac6b05', 'request_id': 'req-7fa6f996-3231-4098-948a-586b559a9e45'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.655504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16bca58f2fe4462a9c33d56dfac6b05', 'request_id': 'req-7fa6f996-3231-4098-948a-586b559a9e45'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.672585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] The token cache is being invalidate because project f16bca58f2fe4462a9c33d56dfac6b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:36.673218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.674554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:36.677103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 849/1696] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:36 2022] DELETE /identity/v3/projects/f16bca58f2fe4462a9c33d56dfac6b05 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:36.678278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:36.680681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:36.700532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:36.704923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:36.741837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f34c41-2d30-4363-865b-6c0e93c74079 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:36.902350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:36.904298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:36.905547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:36.906231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:36.907916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:36.910665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:36.924857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6f996-3231-4098-948a-586b559a9e45 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:36.939667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:36.944191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:36.944468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:36.944730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:36.952393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 848/1697] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:36 2022] POST /identity/v3/users => generated 284 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:36.953688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:36.956750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:36.958445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:36.975086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31277719-6b5e-4c1a-a0df-ddddbdc95495 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:36.983258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:36.984279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:36.984569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:36.984901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] PATH_INFO: `/v3/users/49648f8c52124d9aa3270786199cacd1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:36.986535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49648f8c52124d9aa3270786199cacd1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:36.989190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:37.064947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49648f8c52124d9aa3270786199cacd1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.065646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49648f8c52124d9aa3270786199cacd1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.067066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49648f8c52124d9aa3270786199cacd1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.077088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49648f8c52124d9aa3270786199cacd1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.096094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49648f8c52124d9aa3270786199cacd1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.179502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 849/1698] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:36 2022] DELETE /identity/v3/users/49648f8c52124d9aa3270786199cacd1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:37.185194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:37.187038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:37.198506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:37.204664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:37.245174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 850/1699] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:37.247982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:37.252070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:37.281870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:37.285544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e211d-dd00-4907-9995-c581ebca141e service nova] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:37.347911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2983a1-5d4c-4e04-897e-f511921fefb9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:37.361623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:37.364054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:37.364344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:37.364628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] PATH_INFO: `/v3/users/98ef97cd1a0d490e98716935289c7110` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:37.370074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ef97cd1a0d490e98716935289c7110)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:37.374626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:37.449558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:37.451123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:37.452059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:37.452672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] PATH_INFO: `/v3/projects/a676689c3e1b48b5ba946a8cb1b8b452` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:37.456111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a676689c3e1b48b5ba946a8cb1b8b452)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:37.459717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:37.511595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ef97cd1a0d490e98716935289c7110'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.514812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ef97cd1a0d490e98716935289c7110'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.516009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ef97cd1a0d490e98716935289c7110'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.538266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ef97cd1a0d490e98716935289c7110'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.543854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a676689c3e1b48b5ba946a8cb1b8b452', 'request_id': 'req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.547634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:37.553470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a676689c3e1b48b5ba946a8cb1b8b452', 'request_id': 'req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.566917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a676689c3e1b48b5ba946a8cb1b8b452', 'request_id': 'req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.568674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ef97cd1a0d490e98716935289c7110'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.581267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] The token cache is being invalidate because project a676689c3e1b48b5ba946a8cb1b8b452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:37.581659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.582871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.585595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 851/1700] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:37 2022] DELETE /identity/v3/projects/a676689c3e1b48b5ba946a8cb1b8b452 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:37.586587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:37.588868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:37.651982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 850/1701] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:37 2022] DELETE /identity/v3/users/98ef97cd1a0d490e98716935289c7110 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:37.654168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:37.655976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:37.667361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4dd56-effd-41e8-8cca-a7ad3b09c25c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:37.759497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51facd-420c-4b1c-80c8-4876014b9817 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:37.766917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:37.767949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:37.768376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:37.769046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] PATH_INFO: `/v3/users/d81a50553c3a4c6d9660db92d4bbd217` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:37.770463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81a50553c3a4c6d9660db92d4bbd217)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:37.773002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:37.794835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:37.795577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:37.795970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:37.796349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:37.797154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:37.801646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:37.829033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 852/1702] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:37.838784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:37.862261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a6d5f-bd22-4807-9d75-29eb67344be5 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:37.872993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81a50553c3a4c6d9660db92d4bbd217'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.874849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81a50553c3a4c6d9660db92d4bbd217'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.876468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:37.877043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81a50553c3a4c6d9660db92d4bbd217'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.878522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:37.879773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:37.880185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:37.881596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:37.886095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:37.896855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81a50553c3a4c6d9660db92d4bbd217'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.910511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 853/1703] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:37.917217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:37.918203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81a50553c3a4c6d9660db92d4bbd217'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:37.921355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:37.923941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:37.954486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36eb27-ce0a-4857-be9f-9fe1aaacadb0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:37.959829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 851/1704] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:37 2022] DELETE /identity/v3/users/d81a50553c3a4c6d9660db92d4bbd217 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:38.040032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b9c88-b689-4fff-9ae5-398a0ce3c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:38.040970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9c88-b689-4fff-9ae5-398a0ce3c07e admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:38.041624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9c88-b689-4fff-9ae5-398a0ce3c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:38.042472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9c88-b689-4fff-9ae5-398a0ce3c07e admin admin] PATH_INFO: `/v3/projects/e2b6b26e88fa4e2aa0b4b3a4ec8bff50/users/2e0dd0c240984523a2e6fb2d18e1ac8c/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:38.095850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9c88-b689-4fff-9ae5-398a0ce3c07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b6b26e88fa4e2aa0b4b3a4ec8bff50, user_id=2e0dd0c240984523a2e6fb2d18e1ac8c, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:38.104309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9c88-b689-4fff-9ae5-398a0ce3c07e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:38.116475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:38.155887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 854/1705] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:37 2022] PUT /identity/v3/projects/e2b6b26e88fa4e2aa0b4b3a4ec8bff50/users/2e0dd0c240984523a2e6fb2d18e1ac8c/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:38.158594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:38.161856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:38.162724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:38.163276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:38.164667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:38.204564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0475e97-a0bc-4873-8547-f3760f60d845 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:38.246105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] MFA Rules not processed for user `2e0dd0c240984523a2e6fb2d18e1ac8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:38.247640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:38.392532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:38.393231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:38.393516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:38.393793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] PATH_INFO: `/v3/projects/d499804e1d094bb387fd831b59069aff` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:38.395952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d499804e1d094bb387fd831b59069aff)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:38.399620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:38.435375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 855/1706] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:38.442495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:38.448582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:38.507412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd499804e1d094bb387fd831b59069aff', 'request_id': 'req-c53cc013-1826-4b10-b498-7b692c969b9a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:38.524983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd499804e1d094bb387fd831b59069aff', 'request_id': 'req-c53cc013-1826-4b10-b498-7b692c969b9a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:38.539909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd499804e1d094bb387fd831b59069aff', 'request_id': 'req-c53cc013-1826-4b10-b498-7b692c969b9a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:38.567466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] The token cache is being invalidate because project d499804e1d094bb387fd831b59069aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:38.567776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:38.568463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c53cc013-1826-4b10-b498-7b692c969b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:38.570303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f45517-efa8-464d-931e-0382a1b77009 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:38.571097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 852/1707] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:38 2022] DELETE /identity/v3/projects/d499804e1d094bb387fd831b59069aff => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:38.576431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:38.576726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:38.577014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:38.646655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:38.648901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:38.708811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652d23e-bda7-4823-a7ba-bf1055415857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:38.709431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d23e-bda7-4823-a7ba-bf1055415857 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:38.709713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d23e-bda7-4823-a7ba-bf1055415857 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:38.710410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d23e-bda7-4823-a7ba-bf1055415857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:38.716570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f652d23e-bda7-4823-a7ba-bf1055415857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:38.799712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 853/1708] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:38.800254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:38.803651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:38.831972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f24f89-98f2-4515-9f27-693c5e108ee5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:38.844391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:38.845241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:38.845520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:38.845798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] PATH_INFO: `/v3/projects/356d05b27a3b415a96908b3cc492b2be` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:38.847593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=356d05b27a3b415a96908b3cc492b2be)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:38.849821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:38.864561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:38.868294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:38.869987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d23e-bda7-4823-a7ba-bf1055415857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:38.871749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d23e-bda7-4823-a7ba-bf1055415857 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:38.896403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 856/1709] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:28:38.899807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ee0d5-7b85-4d47-827a-6c67e743a655 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:38.900119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ee0d5-7b85-4d47-827a-6c67e743a655 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:38.900936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ee0d5-7b85-4d47-827a-6c67e743a655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:38.950462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e60ee0d5-7b85-4d47-827a-6c67e743a655 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:38.952118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e60ee0d5-7b85-4d47-827a-6c67e743a655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:38.955214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356d05b27a3b415a96908b3cc492b2be', 'request_id': 'req-b956938e-0516-43aa-83ec-7d1eb18afa0c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:38.970344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356d05b27a3b415a96908b3cc492b2be', 'request_id': 'req-b956938e-0516-43aa-83ec-7d1eb18afa0c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:38.984166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356d05b27a3b415a96908b3cc492b2be', 'request_id': 'req-b956938e-0516-43aa-83ec-7d1eb18afa0c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:39.007866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] The token cache is being invalidate because project 356d05b27a3b415a96908b3cc492b2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:39.008162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:39.010982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b956938e-0516-43aa-83ec-7d1eb18afa0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:39.014114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 854/1710] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:38 2022] DELETE /identity/v3/projects/356d05b27a3b415a96908b3cc492b2be => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:39.020630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53218b7-0d07-4e4e-8092-a0dc28fea0ea None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.020906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53218b7-0d07-4e4e-8092-a0dc28fea0ea None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.021182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53218b7-0d07-4e4e-8092-a0dc28fea0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.062477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c53218b7-0d07-4e4e-8092-a0dc28fea0ea None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:39.064646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c53218b7-0d07-4e4e-8092-a0dc28fea0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:39.092866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 857/1711] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:39.098263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ee0d5-7b85-4d47-827a-6c67e743a655 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.118688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ee0d5-7b85-4d47-827a-6c67e743a655 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.132990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.133618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.134076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.134354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.135555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:39.135863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.141283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.173484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 858/1712] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:39.175310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.200335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f980d-6c2f-46eb-bc26-19b8fe77b2ff admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.217794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.221888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 855/1713] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:39.222039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.222367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.222646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.223726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbf07-f452-4093-9da5-17213cad6bfa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.224134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbf07-f452-4093-9da5-17213cad6bfa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.224318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dbf07-f452-4093-9da5-17213cad6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.229667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.234247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.287119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-036dbf07-f452-4093-9da5-17213cad6bfa None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:39.292052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-036dbf07-f452-4093-9da5-17213cad6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:39.314295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 856/1714] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:39.319378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dbf07-f452-4093-9da5-17213cad6bfa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.328580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 859/1715] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:39.331626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.345504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dbf07-f452-4093-9da5-17213cad6bfa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.498030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.508446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fa689-8a08-473c-8c34-bb4d8aec6273 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.516272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.516617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.517517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.517682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:39.518203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.519424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.519872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.521225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.522362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.523318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.525134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.531916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.578129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 857/1716] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:39.579110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.585921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 860/1717] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:39.588882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.609550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944493db-4aa5-4c0a-bd21-66be6c717f10 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.615446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad81e-aad8-4757-b4df-3bf81c1dde19 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.630674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.631313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.631588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.631854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.632502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.636384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.639200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.640853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.642261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.642261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.644133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.646116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.670012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 861/1718] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:39.670815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.695056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dba9b6-31c5-4586-b604-6a7056519de9 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.705040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.707064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.707356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.708030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.708693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.713649 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.715311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 858/1719] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:39.719078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.730641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:39.750426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 862/1720] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:39.758081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:39.777485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30b987-91cf-4c7e-b8bf-60bacfbdebbe admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.813612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:39.866153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90894d03-a640-4398-962d-b60eb0d3a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.866845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894d03-a640-4398-962d-b60eb0d3a059 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.867445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894d03-a640-4398-962d-b60eb0d3a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.867445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894d03-a640-4398-962d-b60eb0d3a059 admin admin] PATH_INFO: `/v3/projects/2a9fe40bc4f5427089512dacc9bb30db/users/5e7c736c4b13402e8ee7cba6fc0f2fb9/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.886196 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90894d03-a640-4398-962d-b60eb0d3a059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9fe40bc4f5427089512dacc9bb30db, user_id=5e7c736c4b13402e8ee7cba6fc0f2fb9, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.888860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90894d03-a640-4398-962d-b60eb0d3a059 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.890804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182501a5-3703-4fa9-8ae8-9beca9fa1081 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:39.900049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a94aa1-01a9-4718-8ae7-d7b4f42f5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:39.901600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94aa1-01a9-4718-8ae7-d7b4f42f5a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.902128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94aa1-01a9-4718-8ae7-d7b4f42f5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.902713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a94aa1-01a9-4718-8ae7-d7b4f42f5a9d admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.903784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a94aa1-01a9-4718-8ae7-d7b4f42f5a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:39.908533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a94aa1-01a9-4718-8ae7-d7b4f42f5a9d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:39.919631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 863/1721] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:39 2022] PUT /identity/v3/projects/2a9fe40bc4f5427089512dacc9bb30db/users/5e7c736c4b13402e8ee7cba6fc0f2fb9/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:39.921119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56dce-a983-4b41-9594-abec8cff8812 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.921410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56dce-a983-4b41-9594-abec8cff8812 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.921688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b56dce-a983-4b41-9594-abec8cff8812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.943359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 859/1722] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:39.945384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d161d85-cbb9-431d-8c29-726f62b0f848 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:39.945853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d161d85-cbb9-431d-8c29-726f62b0f848 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:39.946284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d161d85-cbb9-431d-8c29-726f62b0f848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:39.965907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e2b56dce-a983-4b41-9594-abec8cff8812 None None] MFA Rules not processed for user `a5fadc5149a94c71a036fde636d596b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:39.967585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e2b56dce-a983-4b41-9594-abec8cff8812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:40.021132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3d161d85-cbb9-431d-8c29-726f62b0f848 None None] MFA Rules not processed for user `5e7c736c4b13402e8ee7cba6fc0f2fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:40.023058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3d161d85-cbb9-431d-8c29-726f62b0f848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:40.093657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 864/1723] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:40.094845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b56dce-a983-4b41-9594-abec8cff8812 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.161997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 860/1724] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:40.163431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca0c3-6905-45cf-80e4-22f7abf42765 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.163835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca0c3-6905-45cf-80e4-22f7abf42765 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.164019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca0c3-6905-45cf-80e4-22f7abf42765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.189138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-29cca0c3-6905-45cf-80e4-22f7abf42765 None None] MFA Rules not processed for user `a5fadc5149a94c71a036fde636d596b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:40.195995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-29cca0c3-6905-45cf-80e4-22f7abf42765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:40.215423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 861/1725] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:40.216357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca0c3-6905-45cf-80e4-22f7abf42765 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.220094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b56dce-a983-4b41-9594-abec8cff8812 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.227872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:40.229677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.230142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.230551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.231518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:40.233529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:40.241427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca0c3-6905-45cf-80e4-22f7abf42765 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.251856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:40.252363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 865/1726] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:40.254498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.256068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.256614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.257085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.257744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:40.258178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:40.260307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:40.324248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 862/1727] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:40 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:40.325554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.330879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:40.393528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efedaa9-351f-47f3-b256-f22c7e46af53 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.403104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:40.427794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8909267-3ad4-458f-9fbe-e0b08612e37d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.435914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:40.436422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.436803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.437178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.438539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:40.440525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:40.462124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 863/1728] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:40.471330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.485541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8270a10-828f-48d6-82cf-59426fda83c6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.496184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:40.496961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.497528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.498424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.499500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:40.502537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:40.528918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:40.531098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.535231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.536676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.560818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 864/1729] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:40 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:40.561947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.579238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b545b-8c48-4485-9310-dab84d556946 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.586526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:40.589540 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.589977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.590389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] PATH_INFO: `/v3/projects/909d838c1e934a1385774bcfad22ec70/users/568fd7b54f0944e09b85a1914926e3fd/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.629422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909d838c1e934a1385774bcfad22ec70, user_id=568fd7b54f0944e09b85a1914926e3fd, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:40.633234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:40.671257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 865/1730] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:40 2022] PUT /identity/v3/projects/909d838c1e934a1385774bcfad22ec70/users/568fd7b54f0944e09b85a1914926e3fd/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:40.679531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.703022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:40.736838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:40.739897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:40.771797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 866/1731] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:40.775249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:40.808896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c7eaa-5937-438c-b4f5-5a85560859c0 service nova] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.949289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169149e6-3596-4cc4-982f-2619872cac72 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:40.963994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:40.964868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:40.965293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:40.965730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] PATH_INFO: `/v3/projects/06dae1de1c884404b9c9df5f66fb4b3e` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:40.967924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dae1de1c884404b9c9df5f66fb4b3e)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:40.972512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:41.087177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955a46-a004-46a9-b2c4-13bdad9408cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:41.088317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955a46-a004-46a9-b2c4-13bdad9408cc admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:41.089427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955a46-a004-46a9-b2c4-13bdad9408cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:41.090610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955a46-a004-46a9-b2c4-13bdad9408cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:41.091474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e955a46-a004-46a9-b2c4-13bdad9408cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:41.093840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e955a46-a004-46a9-b2c4-13bdad9408cc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:41.120530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 867/1732] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:41.122181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b138-2c0b-45dc-a05f-a92b530467ac None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:41.122181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b138-2c0b-45dc-a05f-a92b530467ac None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:41.124586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dae1de1c884404b9c9df5f66fb4b3e', 'request_id': 'req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:41.125982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b138-2c0b-45dc-a05f-a92b530467ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:41.137784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dae1de1c884404b9c9df5f66fb4b3e', 'request_id': 'req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:41.162824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dae1de1c884404b9c9df5f66fb4b3e', 'request_id': 'req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:41.191567 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] The token cache is being invalidate because project 06dae1de1c884404b9c9df5f66fb4b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:28:41.191868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:41.192728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:41.198842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 866/1733] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:40 2022] DELETE /identity/v3/projects/06dae1de1c884404b9c9df5f66fb4b3e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:41.199358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:41.199786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:41.211331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:41.225799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a494b138-2c0b-45dc-a05f-a92b530467ac None None] MFA Rules not processed for user `568fd7b54f0944e09b85a1914926e3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:41.230111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a494b138-2c0b-45dc-a05f-a92b530467ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:41.298040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:41.354248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89107d9-bfaf-4049-ba6a-9851e1ecbe0b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:41.363655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bf419-fe46-488d-ab00-85cc255e8482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:41.364390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bf419-fe46-488d-ab00-85cc255e8482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:41.364628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bf419-fe46-488d-ab00-85cc255e8482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:41.364909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bf419-fe46-488d-ab00-85cc255e8482 admin admin] PATH_INFO: `/v3/projects/e97c69b6e02d410282f0d4d7e99316a1/users/b57bd4eeafa240f78c25dfacc5c41aa6/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:41.401571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bf419-fe46-488d-ab00-85cc255e8482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97c69b6e02d410282f0d4d7e99316a1, user_id=b57bd4eeafa240f78c25dfacc5c41aa6, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:41.413498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bf419-fe46-488d-ab00-85cc255e8482 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:41.438470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 867/1734] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:41 2022] PUT /identity/v3/projects/e97c69b6e02d410282f0d4d7e99316a1/users/b57bd4eeafa240f78c25dfacc5c41aa6/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:41.439877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:41.440545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:41.440545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:41.463843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 868/1735] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:41.466681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494b138-2c0b-45dc-a05f-a92b530467ac None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:41.481074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:41.482268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:41.514164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494b138-2c0b-45dc-a05f-a92b530467ac None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:41.664724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 868/1736] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:41.665727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:41.669019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:41.698189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45114c-e9eb-4e61-a120-9d7036ce01a9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:41.706320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc985018-8c19-47c2-862d-c198ab15fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:41.706945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985018-8c19-47c2-862d-c198ab15fe4a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:41.707229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985018-8c19-47c2-862d-c198ab15fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:41.707506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc985018-8c19-47c2-862d-c198ab15fe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:41.708176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985018-8c19-47c2-862d-c198ab15fe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:41.710094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc985018-8c19-47c2-862d-c198ab15fe4a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:41.722880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:41.723519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:41.723804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:41.724081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:41.724735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:41.726932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:41.759167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 869/1737] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:41.761708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2a3d-8ce8-4d74-a817-0ca9280cb4be None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:41.762000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2a3d-8ce8-4d74-a817-0ca9280cb4be None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:41.765974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce2a3d-8ce8-4d74-a817-0ca9280cb4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:41.817772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 869/1738] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:41 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:41.818842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:41.820658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b5ce2a3d-8ce8-4d74-a817-0ca9280cb4be None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:41.824566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b5ce2a3d-8ce8-4d74-a817-0ca9280cb4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:42.032500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249479c7-f231-4c92-80f2-cd4b8ff9c7f9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.035652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 870/1739] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:42.037008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce2a3d-8ce8-4d74-a817-0ca9280cb4be None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:42.052019 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.052908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.053306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.053693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] PATH_INFO: `/v3/projects/e97c69b6e02d410282f0d4d7e99316a1/users/b57bd4eeafa240f78c25dfacc5c41aa6/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.059953 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97c69b6e02d410282f0d4d7e99316a1, user_id=b57bd4eeafa240f78c25dfacc5c41aa6, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:42.063135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:42.092140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce2a3d-8ce8-4d74-a817-0ca9280cb4be None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.111749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 870/1740] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:41 2022] PUT /identity/v3/projects/e97c69b6e02d410282f0d4d7e99316a1/users/b57bd4eeafa240f78c25dfacc5c41aa6/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:42.122531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:42.198379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:42.220600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:42.278998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.279631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.279908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.280178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.280818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:42.286188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:42.291249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5046800-20db-4e74-b5ad-cd1a871d2258 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.303269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785b2eb-9ee0-4160-8d11-7245caaf6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.304074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785b2eb-9ee0-4160-8d11-7245caaf6688 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.304489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785b2eb-9ee0-4160-8d11-7245caaf6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.304878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785b2eb-9ee0-4160-8d11-7245caaf6688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.305658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785b2eb-9ee0-4160-8d11-7245caaf6688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:28:42.306087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785b2eb-9ee0-4160-8d11-7245caaf6688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:42.310337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785b2eb-9ee0-4160-8d11-7245caaf6688 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:42.344294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 871/1741] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:28:42.347499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b133b-4454-4a49-9979-b72b5a1e4f0c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.348076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b133b-4454-4a49-9979-b72b5a1e4f0c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.348920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b133b-4454-4a49-9979-b72b5a1e4f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.361256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 871/1742] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:42 2022] POST /identity/v3/users => generated 295 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:42.363094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:42.377436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56a9f-03da-40fc-a175-104b37a2e6d5 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.383699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.388123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.388701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.389135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.391287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:42.394578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:42.417012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b19b133b-4454-4a49-9979-b72b5a1e4f0c None None] MFA Rules not processed for user `b57bd4eeafa240f78c25dfacc5c41aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:42.418296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b19b133b-4454-4a49-9979-b72b5a1e4f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:42.456560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 872/1743] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:42 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:42.457890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:42.587368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 872/1744] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:42.588935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbf57-b7c6-4834-8e3f-794a319896e9 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.589228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbf57-b7c6-4834-8e3f-794a319896e9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.590201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbf57-b7c6-4834-8e3f-794a319896e9 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.592556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 873/1745] 10.222.0.18 () {54 vars in 912 bytes} [Fri Sep 30 19:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:28:42.594984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbf57-b7c6-4834-8e3f-794a319896e9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:42.625647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf14eb-e91e-4659-a87d-5eac1678ffd5 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.638821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ac395-dfbb-44c3-9ad7-18b38c6092e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.639623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac395-dfbb-44c3-9ad7-18b38c6092e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.640014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac395-dfbb-44c3-9ad7-18b38c6092e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.640397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ac395-dfbb-44c3-9ad7-18b38c6092e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.641165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ac395-dfbb-44c3-9ad7-18b38c6092e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:42.642928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ac395-dfbb-44c3-9ad7-18b38c6092e4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:42.662482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 873/1746] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:42.664738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf813-435b-408e-a6e4-932da8efca37 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.665102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf813-435b-408e-a6e4-932da8efca37 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.665448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf813-435b-408e-a6e4-932da8efca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.742125 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbf57-b7c6-4834-8e3f-794a319896e9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.746552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-005bf813-435b-408e-a6e4-932da8efca37 None None] MFA Rules not processed for user `38287d3f91704657bc26c5b4d50c0315`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:42.747963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-005bf813-435b-408e-a6e4-932da8efca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:42.753335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.754227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.754696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.755107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.755915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:42.758009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:42.825727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 874/1747] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:42 2022] POST /identity/v3/users => generated 284 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:42.832607 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:42.839083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:42.893086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 874/1748] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:42.894031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bf813-435b-408e-a6e4-932da8efca37 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:42.920249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bf813-435b-408e-a6e4-932da8efca37 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.931770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.932485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.932758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.933035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] PATH_INFO: `/v3/projects/e0afd3ad0fb942f2ad8167c91a9896f9/users/9f57912e80964a2fa7247965b31d009f/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:42.951973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:42.966373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0afd3ad0fb942f2ad8167c91a9896f9, user_id=9f57912e80964a2fa7247965b31d009f, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:42.970723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56f599-0cf2-4264-b798-cfd94e7ad49c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:42.979408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:42.996669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311f908-c996-4e76-92b4-7090b8088468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:42.997298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311f908-c996-4e76-92b4-7090b8088468 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:42.997762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311f908-c996-4e76-92b4-7090b8088468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:42.997889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311f908-c996-4e76-92b4-7090b8088468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:43.003014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0311f908-c996-4e76-92b4-7090b8088468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:43.014122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 875/1749] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:42 2022] PUT /identity/v3/projects/e0afd3ad0fb942f2ad8167c91a9896f9/users/9f57912e80964a2fa7247965b31d009f/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:43.015725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:43.034188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:43.170037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311f908-c996-4e76-92b4-7090b8088468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:43.171726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311f908-c996-4e76-92b4-7090b8088468 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:43.189844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 875/1750] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:43.194162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dcebb-5992-4976-9484-24ea2c54a1f4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:43.195672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dcebb-5992-4976-9484-24ea2c54a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:43.196174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dcebb-5992-4976-9484-24ea2c54a1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:43.239982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb421a3-95d5-4320-84c6-86d1a43460cd admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:43.257848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:43.260337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:43.261489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:43.261878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:43.262978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:43.268963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:43.280521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e46dcebb-5992-4976-9484-24ea2c54a1f4 None None] MFA Rules not processed for user `b4522da7ad4f4620b27e0c0006c520d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:43.283444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e46dcebb-5992-4976-9484-24ea2c54a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:43.304354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 876/1751] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:43.304354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:43.309642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:43.475491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf4f25-b8f2-4321-b8f3-d8a296cd5ca0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:43.486732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:43.488660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:43.489802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:43.490640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:43.515835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:43.518224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:43.537990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 876/1752] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:43.543269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dcebb-5992-4976-9484-24ea2c54a1f4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:43.559318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 877/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:43.560629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:43.568712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dcebb-5992-4976-9484-24ea2c54a1f4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:43.580505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:43.581126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:43.582638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:43.583569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:43.584301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:43.591461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a29d-610f-4d7a-89ea-3a26efbf2b96 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:43.591631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:43.625002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 877/1754] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:43.625435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:43.626146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:43.626435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:43.626713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:43.627371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:43.629010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:43.631034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:43.645221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:43.659919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 878/1755] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:43.660880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:43.696088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca88d5-a89e-4edd-a4ca-917b812eb10e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:43.716467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:43.717267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:43.717487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:43.717709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] PATH_INFO: `/v3/projects/e0afd3ad0fb942f2ad8167c91a9896f9/users/9f57912e80964a2fa7247965b31d009f/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:43.721717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0afd3ad0fb942f2ad8167c91a9896f9, user_id=9f57912e80964a2fa7247965b31d009f, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:43.733475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:43.779406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 879/1756] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:43 2022] PUT /identity/v3/projects/e0afd3ad0fb942f2ad8167c91a9896f9/users/9f57912e80964a2fa7247965b31d009f/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:43.780539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:43.914861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6388e62-ad60-4644-a799-2a31ba70b23e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:43.950329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663a6de-1068-4b68-a883-ad7e8f5debd0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:43.951050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:43.965170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7f6fc-afe3-484a-8903-03fd9f645545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:43.968301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7f6fc-afe3-484a-8903-03fd9f645545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:43.968786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7f6fc-afe3-484a-8903-03fd9f645545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:43.969127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7f6fc-afe3-484a-8903-03fd9f645545 admin admin] PATH_INFO: `/v3/projects/592ee3de7dbe4f77b88315c909aef7a2/users/772fc4929b3a4e6e81677035d849f454/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:44.034759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7f6fc-afe3-484a-8903-03fd9f645545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592ee3de7dbe4f77b88315c909aef7a2, user_id=772fc4929b3a4e6e81677035d849f454, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:44.037480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7f6fc-afe3-484a-8903-03fd9f645545 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:44.089492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 880/1757] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:43 2022] PUT /identity/v3/projects/592ee3de7dbe4f77b88315c909aef7a2/users/772fc4929b3a4e6e81677035d849f454/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:44.091189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013604-a751-4493-a987-fd3bcd0a032c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:44.091532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013604-a751-4493-a987-fd3bcd0a032c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:44.091742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013604-a751-4493-a987-fd3bcd0a032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:44.126496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:44.143764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5f013604-a751-4493-a987-fd3bcd0a032c None None] MFA Rules not processed for user `9f57912e80964a2fa7247965b31d009f`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:44.145139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:44.145279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5f013604-a751-4493-a987-fd3bcd0a032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:44.145791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:44.146113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:44.146506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:44.378989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:44.380618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:44.421647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 881/1759] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:44.426271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f05f-13f9-430f-a6fe-43ec7a17d17a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:44.426271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f05f-13f9-430f-a6fe-43ec7a17d17a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:44.426271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6f05f-13f9-430f-a6fe-43ec7a17d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:44.426495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 878/1758] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:44.441178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:44.549357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3bb6f05f-13f9-430f-a6fe-43ec7a17d17a None None] MFA Rules not processed for user `772fc4929b3a4e6e81677035d849f454`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:44.550718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3bb6f05f-13f9-430f-a6fe-43ec7a17d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:44.660192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500a554-f308-411f-9ade-83786ce1ecb2 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:44.755120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 882/1760] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:44.764114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288501f-a23e-487c-a60b-a16a88dc442c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:44.764114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288501f-a23e-487c-a60b-a16a88dc442c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:44.764114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288501f-a23e-487c-a60b-a16a88dc442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:44.823380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:44.823941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:44.824227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:44.824554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:44.889152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-6288501f-a23e-487c-a60b-a16a88dc442c None None] MFA Rules not processed for user `bd4d957239e1473abbe1b8e2b2fce104`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:44.892059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6288501f-a23e-487c-a60b-a16a88dc442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:44.894145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:45.060382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:45.061897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:45.098144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 879/1761] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:45.101093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:45.130730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 883/1762] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:45.133127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ff3b-40c5-4690-8ecd-e610dbd5181e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:45.135422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ff3b-40c5-4690-8ecd-e610dbd5181e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:45.135965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8ff3b-40c5-4690-8ecd-e610dbd5181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:45.197885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f8c8ff3b-40c5-4690-8ecd-e610dbd5181e None None] MFA Rules not processed for user `74754bc2aec247f596c7f7317e0dc7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:45.201133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f8c8ff3b-40c5-4690-8ecd-e610dbd5181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:45.274593 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:45.307858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3fe16-9677-4f47-a479-55cc7ab42ca5 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:45.331415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267c08c-10d6-4ef1-92d0-25925a9b36f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:45.332058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267c08c-10d6-4ef1-92d0-25925a9b36f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:45.332439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267c08c-10d6-4ef1-92d0-25925a9b36f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:45.332608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267c08c-10d6-4ef1-92d0-25925a9b36f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:45.333308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267c08c-10d6-4ef1-92d0-25925a9b36f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:45.335482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267c08c-10d6-4ef1-92d0-25925a9b36f5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:45.456719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 880/1763] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:28:45 2022] POST /identity/v3/projects => generated 367 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:45.463329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:45.463622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:45.463903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:45.506713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 884/1764] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:45.508016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ff3b-40c5-4690-8ecd-e610dbd5181e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:45.544262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8ff3b-40c5-4690-8ecd-e610dbd5181e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:45.546382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] MFA Rules not processed for user `bd4d957239e1473abbe1b8e2b2fce104`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:45.547630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:45.720169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 881/1765] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:45.721225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:45.727881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:45.832276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f77ac7-542d-426e-8fb2-cf3c46b7247b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:45.832654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77ac7-542d-426e-8fb2-cf3c46b7247b admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:45.832917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77ac7-542d-426e-8fb2-cf3c46b7247b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:45.833200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f77ac7-542d-426e-8fb2-cf3c46b7247b admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:45.833851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77ac7-542d-426e-8fb2-cf3c46b7247b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:45.836103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f77ac7-542d-426e-8fb2-cf3c46b7247b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:45.876539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 885/1766] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:28:45 2022] POST /identity/v3/users => generated 290 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:28:45.877797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:45.878106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:45.878385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:45.940736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] MFA Rules not processed for user `a5fadc5149a94c71a036fde636d596b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:45.942010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:45.942164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:46.038694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97fc7-c6c1-4bf8-920e-f95bfeebabc7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:46.057142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:46.061339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.061339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.061339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.065929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:46.092212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 886/1767] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:46.094480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:46.096766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:46.138429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:46.140583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:46.163615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 882/1768] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:46.167023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:46.196396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8465a0-a38f-46e4-8879-4f03177fb019 service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:46.208743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:46.209913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.210904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.211760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.214039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:46.216617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:46.243276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 883/1769] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:46.244582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:46.266650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55479f5a-bdf2-47f3-b3d9-da8a01c86065 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:46.277445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:46.279225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.279752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:46.281333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.281733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] PATH_INFO: `/v3/projects/9389c439e2a54d5999a4a58e2bea2ddc/users/a83435d853f54f70be4ed185cd5b12cf/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.332823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9389c439e2a54d5999a4a58e2bea2ddc, user_id=a83435d853f54f70be4ed185cd5b12cf, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:46.336082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:46.339625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895a189-0dba-4b74-ba54-468a883e0f0e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:46.353698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:46.354470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.354753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.355031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.382146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 884/1770] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:46 2022] PUT /identity/v3/projects/9389c439e2a54d5999a4a58e2bea2ddc/users/a83435d853f54f70be4ed185cd5b12cf/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:46.383561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:46.385956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:46.389713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:46.421367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 887/1771] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:46.546010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a462e-bba6-4b16-8978-522398f5ee10 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:46.551887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db48f-087b-42f7-9d58-e668e97c2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:46.552747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db48f-087b-42f7-9d58-e668e97c2a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.553034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db48f-087b-42f7-9d58-e668e97c2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.553312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db48f-087b-42f7-9d58-e668e97c2a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.553969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db48f-087b-42f7-9d58-e668e97c2a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:46.555727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db48f-087b-42f7-9d58-e668e97c2a9d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:46.575435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 885/1772] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:28:46.576638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:46.590514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd4ba1-5489-4823-893d-a42c6018e55e service nova] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:46.640840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f6d2a-3aa6-4cb2-a00a-81e3508b2274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:46.640840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6d2a-3aa6-4cb2-a00a-81e3508b2274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.640840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6d2a-3aa6-4cb2-a00a-81e3508b2274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.640840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f6d2a-3aa6-4cb2-a00a-81e3508b2274 admin admin] PATH_INFO: `/v3/projects/9389c439e2a54d5999a4a58e2bea2ddc/users/a83435d853f54f70be4ed185cd5b12cf/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.641378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f6d2a-3aa6-4cb2-a00a-81e3508b2274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9389c439e2a54d5999a4a58e2bea2ddc, user_id=a83435d853f54f70be4ed185cd5b12cf, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:46.645513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f6d2a-3aa6-4cb2-a00a-81e3508b2274 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:46.693080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 888/1773] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:28:46 2022] PUT /identity/v3/projects/9389c439e2a54d5999a4a58e2bea2ddc/users/a83435d853f54f70be4ed185cd5b12cf/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:46.707923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.708523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.709123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.774482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] MFA Rules not processed for user `a83435d853f54f70be4ed185cd5b12cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:46.776944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:46.858206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da9b15-8a32-42f6-99a5-9e83df8c885e None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.858488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da9b15-8a32-42f6-99a5-9e83df8c885e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.858763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da9b15-8a32-42f6-99a5-9e83df8c885e None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.860633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 889/1774] 10.222.0.18 () {54 vars in 912 bytes} [Fri Sep 30 19:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:28:46.869522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8535639-c960-4231-bc95-efb416e09800 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:46.869828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8535639-c960-4231-bc95-efb416e09800 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:46.870111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8535639-c960-4231-bc95-efb416e09800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:46.910045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f8535639-c960-4231-bc95-efb416e09800 None None] MFA Rules not processed for user `38287d3f91704657bc26c5b4d50c0315`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:46.911403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f8535639-c960-4231-bc95-efb416e09800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:46.939215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 886/1775] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:46.950653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:46.952120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:47.027712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:47.033829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 890/1776] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:28:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:47.078619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8535639-c960-4231-bc95-efb416e09800 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:47.113544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8535639-c960-4231-bc95-efb416e09800 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:47.117470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063b5e-f276-4293-8ee2-5d2eaddddaa8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:47.122197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:47.122873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:47.123153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:47.123425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:47.124914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:47.126017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:47.126655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:47.126936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:47.135486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:47.137181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:47.147345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 891/1777] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:47.151292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:47.155006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:47.156513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:47.169638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4d80-ff3b-4cc4-ae3d-8ecb6d61a029 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:47.173895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 887/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:47.183918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f327433a-697b-4968-b8fa-b94822e49449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:47.184545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327433a-697b-4968-b8fa-b94822e49449 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:47.184824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327433a-697b-4968-b8fa-b94822e49449 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:47.185096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f327433a-697b-4968-b8fa-b94822e49449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:47.273368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:47.288893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b30d7-acb1-41a7-a88d-5be93bc20076 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:47.295342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:47.296277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:47.296999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:47.297435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:47.349187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327433a-697b-4968-b8fa-b94822e49449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:47.350794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f327433a-697b-4968-b8fa-b94822e49449 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:47.387357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 892/1779] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:47.485286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:47.485286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:47.518755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 888/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:48.239008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d16ec7-0a38-4b93-85fb-a564c628347f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:48.239504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d16ec7-0a38-4b93-85fb-a564c628347f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:48.239973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d16ec7-0a38-4b93-85fb-a564c628347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:48.291653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-44d16ec7-0a38-4b93-85fb-a564c628347f None None] MFA Rules not processed for user `b4522da7ad4f4620b27e0c0006c520d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:48.295176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-44d16ec7-0a38-4b93-85fb-a564c628347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:48.409777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:48.436703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 893/1781] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:50.166602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:50.179302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0741a7-79bc-4a23-ba51-66ab6ed89594 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:50.189148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c068-1540-4aa0-9dad-2df75ed98d6a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:50.189663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c068-1540-4aa0-9dad-2df75ed98d6a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:50.189838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2c068-1540-4aa0-9dad-2df75ed98d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:50.192527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:50.196291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:50.197307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:50.198603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:50.334950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:50.339620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:50.355761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-baf2c068-1540-4aa0-9dad-2df75ed98d6a None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:50.359915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-baf2c068-1540-4aa0-9dad-2df75ed98d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:50.373506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 889/1782] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:50.574078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 894/1783] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:28:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:50.901233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:50.903606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:51.099315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:51.164543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85800f-5921-4abc-8a56-90e18738165c service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:51.183907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab289a17-2b4a-4740-8e84-6a1c26f23013 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:51.184564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab289a17-2b4a-4740-8e84-6a1c26f23013 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:51.184799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab289a17-2b4a-4740-8e84-6a1c26f23013 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:51.196164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab289a17-2b4a-4740-8e84-6a1c26f23013 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:51.247756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab289a17-2b4a-4740-8e84-6a1c26f23013 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:51.250216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab289a17-2b4a-4740-8e84-6a1c26f23013 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:51.284969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 890/1784] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:28:53.166951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2c068-1540-4aa0-9dad-2df75ed98d6a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:53.409917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2c068-1540-4aa0-9dad-2df75ed98d6a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:53.431727 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:53.432440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:53.432714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:53.438659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] PATH_INFO: `/v3/users/568fd7b54f0944e09b85a1914926e3fd` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:53.441177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568fd7b54f0944e09b85a1914926e3fd)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:53.447754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:53.633311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568fd7b54f0944e09b85a1914926e3fd'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:53.661729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568fd7b54f0944e09b85a1914926e3fd'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:53.667843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568fd7b54f0944e09b85a1914926e3fd'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:53.694507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568fd7b54f0944e09b85a1914926e3fd'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:53.702683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568fd7b54f0944e09b85a1914926e3fd'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:53.760501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:53.833585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 895/1785] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:53 2022] DELETE /identity/v3/users/568fd7b54f0944e09b85a1914926e3fd => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:53.840108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:53.840601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:53.840742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:53.931890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:53.933783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:54.137449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 891/1786] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:54.476816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:54.479351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:54.744975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:54.746790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:54.784123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80053-0dfe-453b-88e2-bf95e2002647 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:54.802025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1127f-6190-4c1f-a640-c40cb21fa522 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:54.814158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:54.814851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:54.815160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:54.818530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:54.819181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:54.819461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:54.820776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] PATH_INFO: `/v3/users/5e7c736c4b13402e8ee7cba6fc0f2fb9` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:54.823961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7c736c4b13402e8ee7cba6fc0f2fb9)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:54.825909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:54.835039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:54.874394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:54.877984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:54.940942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 896/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:54.943968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:54.969497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:55.086320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34a41e-bf28-48c4-a128-eafe9961a5ee service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:55.112803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:55.118859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:55.119596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7c736c4b13402e8ee7cba6fc0f2fb9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.121159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:55.122826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] PATH_INFO: `/v3/users/772fc4929b3a4e6e81677035d849f454` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:55.125154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7c736c4b13402e8ee7cba6fc0f2fb9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.127950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] RBAC: Authorizing `identity:delete_user(user_id=772fc4929b3a4e6e81677035d849f454)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:55.129022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7c736c4b13402e8ee7cba6fc0f2fb9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.151795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:55.181598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7c736c4b13402e8ee7cba6fc0f2fb9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.236531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9e505d19-27c4-4745-b4b8-5553f9a26a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7c736c4b13402e8ee7cba6fc0f2fb9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.360415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 892/1788] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:54 2022] DELETE /identity/v3/users/5e7c736c4b13402e8ee7cba6fc0f2fb9 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:28:55.374313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:55.374772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:55.375193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:55.383492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772fc4929b3a4e6e81677035d849f454'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.414094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772fc4929b3a4e6e81677035d849f454'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.417339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772fc4929b3a4e6e81677035d849f454'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.448024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:55.448984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772fc4929b3a4e6e81677035d849f454'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.452423 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:55.452913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-921016a7-6aed-42e3-96ba-5d85f6e6829d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772fc4929b3a4e6e81677035d849f454'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:55.579991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:55.580330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 897/1789] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:54 2022] DELETE /identity/v3/users/772fc4929b3a4e6e81677035d849f454 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:55.585034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:55.585323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:55.585689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:55.681323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:55.683960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:55.698815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 893/1790] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:55.847317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:55.848993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:55.876029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 898/1791] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:56.087959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:56.090739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:56.091489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815e230-4a10-40d4-8ecf-86e5c662ae44 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:56.112712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:56.285870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5dfdc1-b5e4-4c9d-b0fd-2770aa9c778d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:56.286561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dfdc1-b5e4-4c9d-b0fd-2770aa9c778d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:56.286977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dfdc1-b5e4-4c9d-b0fd-2770aa9c778d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:56.287256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5dfdc1-b5e4-4c9d-b0fd-2770aa9c778d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:56.307030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dfdc1-b5e4-4c9d-b0fd-2770aa9c778d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:56.313270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5dfdc1-b5e4-4c9d-b0fd-2770aa9c778d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:56.317980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1c882-44e1-4090-99a7-eb90fd841d58 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:56.325846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:56.326975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:56.347709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:56.348361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:56.366477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 894/1792] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:56.367888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:56.368171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:56.373007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:56.377256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:56.378661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:56.396475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 899/1793] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:28:56.468408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] MFA Rules not processed for user `38287d3f91704657bc26c5b4d50c0315`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:56.469654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:56.498418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 895/1794] 10.222.0.39 () {58 vars in 1015 bytes} [Fri Sep 30 19:28:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:56.675304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:56.705898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21128465-00b0-4a26-90e6-f4b01eb1d42b service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:56.723916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cabad2-85f4-4279-a93d-8dad907fef95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:56.724569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cabad2-85f4-4279-a93d-8dad907fef95 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:56.724855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cabad2-85f4-4279-a93d-8dad907fef95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:56.725137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cabad2-85f4-4279-a93d-8dad907fef95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:56.756907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cabad2-85f4-4279-a93d-8dad907fef95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:56.757224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cabad2-85f4-4279-a93d-8dad907fef95 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:56.772134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 900/1795] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:58.552751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:58.555804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:58.587655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b498b-6280-4943-a129-b0aabd318b35 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:58.623620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:58.625504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:58.626350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:58.627526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] PATH_INFO: `/v3/users/2e0dd0c240984523a2e6fb2d18e1ac8c` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:58.629564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0dd0c240984523a2e6fb2d18e1ac8c)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:58.636991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:58.809728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0dd0c240984523a2e6fb2d18e1ac8c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:58.811948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0dd0c240984523a2e6fb2d18e1ac8c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:58.815571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0dd0c240984523a2e6fb2d18e1ac8c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:58.838781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0dd0c240984523a2e6fb2d18e1ac8c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:58.851104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0dd0c240984523a2e6fb2d18e1ac8c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:28:58.881772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:58.882775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:58.883466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:58.887692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 896/1796] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:28:58 2022] DELETE /identity/v3/users/2e0dd0c240984523a2e6fb2d18e1ac8c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:28:58.908439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:28:58.910158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:59.052442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 901/1797] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:28:59.254524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:59.258785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:59.314477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:28:59.427016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e24c6-5a04-479f-befd-fe7905f9e031 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:59.454763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:59.456311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:59.457665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:59.458448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:59.470539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:59.472216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:59.484959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 897/1798] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:28:59.818299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:59.841658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:59.858563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499d94a-5cf1-4f7d-a0bc-d87dbaf829fb None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:59.878416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:28:59.880099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:28:59.897863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:59.899691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:59.900201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:59.900839 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] PATH_INFO: `/v3/projects/909d838c1e934a1385774bcfad22ec70` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:59.902789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=909d838c1e934a1385774bcfad22ec70)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:59.908759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:28:59.943686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50e17c-205e-49e6-80bb-e3b8a0035221 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:28:59.985997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:28:59.986594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:28:59.987012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:28:59.987134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] PATH_INFO: `/v3/projects/592ee3de7dbe4f77b88315c909aef7a2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:28:59.995866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592ee3de7dbe4f77b88315c909aef7a2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:28:59.997811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:00.065537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909d838c1e934a1385774bcfad22ec70', 'request_id': 'req-50687b31-8ee2-4917-a868-51bcff91a2fb'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.112283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909d838c1e934a1385774bcfad22ec70', 'request_id': 'req-50687b31-8ee2-4917-a868-51bcff91a2fb'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.143899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909d838c1e934a1385774bcfad22ec70', 'request_id': 'req-50687b31-8ee2-4917-a868-51bcff91a2fb'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.190447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] The token cache is being invalidate because project 909d838c1e934a1385774bcfad22ec70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:00.191727 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.193121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.198372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 902/1799] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:59 2022] DELETE /identity/v3/projects/909d838c1e934a1385774bcfad22ec70 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:00.202867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:00.204398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:00.209029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592ee3de7dbe4f77b88315c909aef7a2', 'request_id': 'req-4e45a57f-157a-4ab0-8962-fd2efeec1f64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.234252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592ee3de7dbe4f77b88315c909aef7a2', 'request_id': 'req-4e45a57f-157a-4ab0-8962-fd2efeec1f64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.249304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592ee3de7dbe4f77b88315c909aef7a2', 'request_id': 'req-4e45a57f-157a-4ab0-8962-fd2efeec1f64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.285496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] The token cache is being invalidate because project 592ee3de7dbe4f77b88315c909aef7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:00.285817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.286563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.291345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:00.292424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 898/1800] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:28:59 2022] DELETE /identity/v3/projects/592ee3de7dbe4f77b88315c909aef7a2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:00.297325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:00.301722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:00.486957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a57f-157a-4ab0-8962-fd2efeec1f64 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:00.504147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:00.507231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50687b31-8ee2-4917-a868-51bcff91a2fb admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:00.509324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:00.509756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:00.510424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] PATH_INFO: `/v3/users/a83435d853f54f70be4ed185cd5b12cf` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:00.511920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a83435d853f54f70be4ed185cd5b12cf)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:00.514390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:00.527955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:00.528878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:00.529277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:00.529731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] PATH_INFO: `/v3/users/9f57912e80964a2fa7247965b31d009f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:00.533033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f57912e80964a2fa7247965b31d009f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:00.538894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:00.605031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:00.623884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a83435d853f54f70be4ed185cd5b12cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.625429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a83435d853f54f70be4ed185cd5b12cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.626201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a83435d853f54f70be4ed185cd5b12cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.639893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a83435d853f54f70be4ed185cd5b12cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.653276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a83435d853f54f70be4ed185cd5b12cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.653746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f57912e80964a2fa7247965b31d009f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.666833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f57912e80964a2fa7247965b31d009f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.667596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f57912e80964a2fa7247965b31d009f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.688285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f57912e80964a2fa7247965b31d009f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.689477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f57912e80964a2fa7247965b31d009f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:00.728386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 899/1801] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:00 2022] DELETE /identity/v3/users/a83435d853f54f70be4ed185cd5b12cf => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:00.736318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 903/1802] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:00 2022] DELETE /identity/v3/users/9f57912e80964a2fa7247965b31d009f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:01.213596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:01.219043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:01.298102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:01.301088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:01.433755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b90c9-7fdc-4b99-9480-963d51eeeaae admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:01.541198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d5e1-1570-442c-a64f-9562cc93e73e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:01.558427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:01.559475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:01.559764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:01.560047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] PATH_INFO: `/v3/projects/e2b6b26e88fa4e2aa0b4b3a4ec8bff50` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:01.565345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b6b26e88fa4e2aa0b4b3a4ec8bff50)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:01.572053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:01.637449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:01.638418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:01.638699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:01.638973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] PATH_INFO: `/v3/projects/2a9fe40bc4f5427089512dacc9bb30db` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:01.644229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9fe40bc4f5427089512dacc9bb30db)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:01.646833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:01.711183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:01.733268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b6b26e88fa4e2aa0b4b3a4ec8bff50', 'request_id': 'req-e9c6e37c-acfc-4855-815e-a625602a3fe1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.799225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9fe40bc4f5427089512dacc9bb30db', 'request_id': 'req-3f6ab683-e857-4c97-a467-611afca95612'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.803813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b6b26e88fa4e2aa0b4b3a4ec8bff50', 'request_id': 'req-e9c6e37c-acfc-4855-815e-a625602a3fe1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.816582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9fe40bc4f5427089512dacc9bb30db', 'request_id': 'req-3f6ab683-e857-4c97-a467-611afca95612'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.839941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b6b26e88fa4e2aa0b4b3a4ec8bff50', 'request_id': 'req-e9c6e37c-acfc-4855-815e-a625602a3fe1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.842624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9fe40bc4f5427089512dacc9bb30db', 'request_id': 'req-3f6ab683-e857-4c97-a467-611afca95612'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.846821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:01.865168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] The token cache is being invalidate because project 2a9fe40bc4f5427089512dacc9bb30db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:01.865484 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.867250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.873528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 900/1803] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:01 2022] DELETE /identity/v3/projects/2a9fe40bc4f5427089512dacc9bb30db => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:01.874564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:01.876840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:01.880770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] The token cache is being invalidate because project e2b6b26e88fa4e2aa0b4b3a4ec8bff50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:01.881072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.884249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e9c6e37c-acfc-4855-815e-a625602a3fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:01.892853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 904/1804] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:01 2022] DELETE /identity/v3/projects/e2b6b26e88fa4e2aa0b4b3a4ec8bff50 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:01.897708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aece27-4fd1-491a-a2c8-859a4edcc2ea None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:01.898219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aece27-4fd1-491a-a2c8-859a4edcc2ea None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:01.898899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aece27-4fd1-491a-a2c8-859a4edcc2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:01.951978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-59aece27-4fd1-491a-a2c8-859a4edcc2ea None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:01.953626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-59aece27-4fd1-491a-a2c8-859a4edcc2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:01.972339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab683-e857-4c97-a467-611afca95612 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:01.980053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:01.981378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:01.981507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 905/1805] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:01.982151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:01.982697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] PATH_INFO: `/v3/users/b57bd4eeafa240f78c25dfacc5c41aa6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:01.983739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29141d2f-3552-4e04-9b3c-5adc33e88ba8 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:01.984124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29141d2f-3552-4e04-9b3c-5adc33e88ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:01.984403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29141d2f-3552-4e04-9b3c-5adc33e88ba8 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:01.984828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57bd4eeafa240f78c25dfacc5c41aa6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:01.987560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 906/1806] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:29:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:29:01.988502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:01.989057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956842-b1f4-44c7-9890-23740a4e2127 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:01.989449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956842-b1f4-44c7-9890-23740a4e2127 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:01.989882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956842-b1f4-44c7-9890-23740a4e2127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:02.043621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b7956842-b1f4-44c7-9890-23740a4e2127 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:02.052237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b7956842-b1f4-44c7-9890-23740a4e2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:02.078592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 907/1807] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:02.083157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956842-b1f4-44c7-9890-23740a4e2127 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:02.087335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57bd4eeafa240f78c25dfacc5c41aa6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:02.091471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57bd4eeafa240f78c25dfacc5c41aa6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:02.093555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57bd4eeafa240f78c25dfacc5c41aa6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:02.109686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956842-b1f4-44c7-9890-23740a4e2127 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:02.112309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57bd4eeafa240f78c25dfacc5c41aa6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:02.124951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:02.125759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:02.126142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:02.126383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:02.127338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:02.127622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:02.138097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95bdc4b4-c026-4743-811b-5e5d754e08ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57bd4eeafa240f78c25dfacc5c41aa6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:02.139952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:02.171189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 908/1808] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:02.174333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:02.181800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:02.183085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 901/1809] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:01 2022] DELETE /identity/v3/users/b57bd4eeafa240f78c25dfacc5c41aa6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:02.198217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb233b-6b3d-4c2d-bf9c-521a221651ee admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:02.268726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cfe3-fc43-4f51-813d-8214bba36039 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:02.269760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cfe3-fc43-4f51-813d-8214bba36039 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:02.270129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1cfe3-fc43-4f51-813d-8214bba36039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:02.311655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-93c1cfe3-fc43-4f51-813d-8214bba36039 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:02.316636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-93c1cfe3-fc43-4f51-813d-8214bba36039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:02.335357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:02.338328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:02.339612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:02.339826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:02.341254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:02.344605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:02.414742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 909/1810] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:02 2022] POST /identity/v3/projects => generated 377 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:02.416964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:02.500628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 902/1811] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:29:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:02.573018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba84a-6fda-4e9c-8866-b26e2aa80572 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:02.601417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:02.604029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:02.604271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:02.604549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:02.605198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:02.618222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:02.661948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 910/1812] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:02 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:02.666943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cfe3-fc43-4f51-813d-8214bba36039 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:02.696473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:02.714476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1cfe3-fc43-4f51-813d-8214bba36039 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:02.721872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:02.723129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:02.724213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:02.724926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:02.725975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:02.729497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:02.798768 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:02.801795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 903/1813] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:02.815946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89665699-4e0f-462a-a7e5-4e38ab8de587 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:02.871965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7c648-03bc-452e-92f7-654ca7543999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:02.874753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c648-03bc-452e-92f7-654ca7543999 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:02.875804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c648-03bc-452e-92f7-654ca7543999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:02.876945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c648-03bc-452e-92f7-654ca7543999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:02.879489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c648-03bc-452e-92f7-654ca7543999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:02.885202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c648-03bc-452e-92f7-654ca7543999 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:02.918107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 911/1814] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:02.921363 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:02.943574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad13480-5a02-421e-b23c-13887dd23fc2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:02.963853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:02.965044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:02.965044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:02.965521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] PATH_INFO: `/v3/projects/fa993656c8634583b9350f92ff3e31b5/users/e130bb7af152475fa8e986c33be6f177/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:03.013942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa993656c8634583b9350f92ff3e31b5, user_id=e130bb7af152475fa8e986c33be6f177, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:03.017259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:03.053886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 904/1815] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:02 2022] PUT /identity/v3/projects/fa993656c8634583b9350f92ff3e31b5/users/e130bb7af152475fa8e986c33be6f177/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:03.067411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb00039-2b1c-46e5-99ef-b12cbb34813c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:03.067698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb00039-2b1c-46e5-99ef-b12cbb34813c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:03.074665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb00039-2b1c-46e5-99ef-b12cbb34813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:03.107975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:03.156739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9fb00039-2b1c-46e5-99ef-b12cbb34813c None None] MFA Rules not processed for user `e130bb7af152475fa8e986c33be6f177`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:03.162024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9fb00039-2b1c-46e5-99ef-b12cbb34813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:03.331186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 912/1816] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:03.335351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:03.446719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cfc01-70b5-4eaa-96fa-fee428a9852e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:03.452511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:03.453263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:03.453616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:03.453961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:03.454756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:03.456782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:03.517586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 905/1817] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:03 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:03.521537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb00039-2b1c-46e5-99ef-b12cbb34813c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:03.540531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb00039-2b1c-46e5-99ef-b12cbb34813c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:03.675751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:03.676452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:03.676742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:03.677018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:03.677658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:03.680269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:03.718927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 913/1818] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:03 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:03.719621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:03.742735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b331bf-df80-404e-b993-ae9b80486b2d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:03.763109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:03.764176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:03.764882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:03.765192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:03.766382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:03.768467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:03.805727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 906/1819] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:03.807140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:03.821644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa21cb-d379-4947-911e-7f5b89160bc5 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:03.837913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:03.838638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:03.838922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:03.840006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] PATH_INFO: `/v3/projects/906577b2c3e24300bf4c8b2c5fb8009b/users/db5d6c12339f4a00abb62fba8f278ae1/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:03.879777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906577b2c3e24300bf4c8b2c5fb8009b, user_id=db5d6c12339f4a00abb62fba8f278ae1, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:03.883463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:03.916677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 914/1820] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:03 2022] PUT /identity/v3/projects/906577b2c3e24300bf4c8b2c5fb8009b/users/db5d6c12339f4a00abb62fba8f278ae1/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:03.918242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:03.941898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092f7e-69bb-4a25-8816-4ad495b4d982 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:04.064447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a2e8c-8a57-4405-a34f-63ece2cc3fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:04.065108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2e8c-8a57-4405-a34f-63ece2cc3fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:04.065408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2e8c-8a57-4405-a34f-63ece2cc3fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:04.065650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a2e8c-8a57-4405-a34f-63ece2cc3fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:04.069643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a2e8c-8a57-4405-a34f-63ece2cc3fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:04.072483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a2e8c-8a57-4405-a34f-63ece2cc3fb8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:04.105900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:04.106794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 907/1821] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:04.123221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfa34a-282f-4f55-a567-79aacb1e6b09 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:04.134721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:04.135757 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:04.136276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:04.136764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] PATH_INFO: `/v3/projects/906577b2c3e24300bf4c8b2c5fb8009b/users/db5d6c12339f4a00abb62fba8f278ae1/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:04.142696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906577b2c3e24300bf4c8b2c5fb8009b, user_id=db5d6c12339f4a00abb62fba8f278ae1, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:04.149805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:04.173900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 915/1822] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:04 2022] PUT /identity/v3/projects/906577b2c3e24300bf4c8b2c5fb8009b/users/db5d6c12339f4a00abb62fba8f278ae1/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:04.187009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:04.187528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:04.187856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:04.328735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] MFA Rules not processed for user `db5d6c12339f4a00abb62fba8f278ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:04.331387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:04.378580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:04.458151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 908/1823] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:04.470428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:04.473136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:04.561944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:04.566395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820edf57-10ae-402b-bb50-1bd0b0c55651 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:04.572173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:04.573470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:04.574424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:04.575117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:04.661940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:04.663826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:04.677677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 916/1824] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:04.841653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:04.848105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:05.172607 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25d1a9-2a69-4d0b-b830-58006b7f4902 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:05.201238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:05.201866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:05.202167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:05.202447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:05.231158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:05.232812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:05.234972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:05.236644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:05.331291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 909/1825] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:05.342987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:05.346507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:05.479957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930d177-ecf6-43c5-bfff-88763a1f3073 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:05.495246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:05.496274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:05.496935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:05.497563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] PATH_INFO: `/v3/projects/e0afd3ad0fb942f2ad8167c91a9896f9` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:05.499740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0afd3ad0fb942f2ad8167c91a9896f9)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:05.502508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:05.654669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0afd3ad0fb942f2ad8167c91a9896f9', 'request_id': 'req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.656510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185253-a4d6-486a-81d9-1dd9f2078ac4 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:05.675672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0afd3ad0fb942f2ad8167c91a9896f9', 'request_id': 'req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.688573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0afd3ad0fb942f2ad8167c91a9896f9', 'request_id': 'req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.705650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] The token cache is being invalidate because project e0afd3ad0fb942f2ad8167c91a9896f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:05.706807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.708565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-7b09c820-b0fb-40a6-b53e-ac7a67b85e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.710754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 917/1826] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:05 2022] DELETE /identity/v3/projects/e0afd3ad0fb942f2ad8167c91a9896f9 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:05.712877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355d27-6141-4b7a-981d-c1c0371b5caa None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:05.713892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355d27-6141-4b7a-981d-c1c0371b5caa None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:05.714379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c355d27-6141-4b7a-981d-c1c0371b5caa None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:05.716160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 918/1827] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:29:05.718493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c313d3f-14b7-4237-8dc2-8707dbb5d05e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:05.718982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c313d3f-14b7-4237-8dc2-8707dbb5d05e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:05.719422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c313d3f-14b7-4237-8dc2-8707dbb5d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:05.742585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:05.747108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-0c313d3f-14b7-4237-8dc2-8707dbb5d05e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:05.749193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0c313d3f-14b7-4237-8dc2-8707dbb5d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:05.754144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:05.755011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:05.755470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:05.755951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] PATH_INFO: `/v3/projects/9389c439e2a54d5999a4a58e2bea2ddc` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:05.757358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9389c439e2a54d5999a4a58e2bea2ddc)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:05.760782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:05.769137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 919/1828] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:05.770995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:05.771479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:05.771923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:05.801442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:05.803317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:05.849826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:05.881602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9389c439e2a54d5999a4a58e2bea2ddc', 'request_id': 'req-d1c4fc21-de96-4d0d-9685-23fb145f7d46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.901404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9389c439e2a54d5999a4a58e2bea2ddc', 'request_id': 'req-d1c4fc21-de96-4d0d-9685-23fb145f7d46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.922119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9389c439e2a54d5999a4a58e2bea2ddc', 'request_id': 'req-d1c4fc21-de96-4d0d-9685-23fb145f7d46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.944466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] The token cache is being invalidate because project 9389c439e2a54d5999a4a58e2bea2ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:05.944758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.947729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d1c4fc21-de96-4d0d-9685-23fb145f7d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:05.950555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 910/1829] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:05 2022] DELETE /identity/v3/projects/9389c439e2a54d5999a4a58e2bea2ddc => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:05.952467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c85aa-807e-446d-9f4c-03629a2cc72b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:05.952968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c85aa-807e-446d-9f4c-03629a2cc72b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:05.953482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c85aa-807e-446d-9f4c-03629a2cc72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:05.966331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 920/1830] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:29:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:05.967215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:05.968501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:05.984768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fe8c85aa-807e-446d-9f4c-03629a2cc72b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:05.986187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fe8c85aa-807e-446d-9f4c-03629a2cc72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:05.988892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da92ea-d65f-4e61-a12e-ce44f5f103e2 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.069077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.070349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.070763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.071444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] PATH_INFO: `/v3/projects/e97c69b6e02d410282f0d4d7e99316a1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.072728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97c69b6e02d410282f0d4d7e99316a1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.075204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.084591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 911/1831] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:06.086269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.086586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.087098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.111920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:06.113151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:06.124166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 912/1832] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:06.125537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.127907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:06.160191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97c69b6e02d410282f0d4d7e99316a1', 'request_id': 'req-15290bdf-5849-442c-ba15-2846817b704c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:06.168034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97c69b6e02d410282f0d4d7e99316a1', 'request_id': 'req-15290bdf-5849-442c-ba15-2846817b704c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:06.180099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97c69b6e02d410282f0d4d7e99316a1', 'request_id': 'req-15290bdf-5849-442c-ba15-2846817b704c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:06.197057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] The token cache is being invalidate because project e97c69b6e02d410282f0d4d7e99316a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:06.197921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:06.199432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:06.205876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 921/1833] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:05 2022] DELETE /identity/v3/projects/e97c69b6e02d410282f0d4d7e99316a1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:06.205876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.205876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:06.250395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344dfbc-07e7-4b6b-a2b3-cd10ddbdc256 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.265724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:06.267315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:06.291260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15290bdf-5849-442c-ba15-2846817b704c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.297172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f596c9b-80cb-40e3-9b70-1806a697b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.297904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f596c9b-80cb-40e3-9b70-1806a697b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.298307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f596c9b-80cb-40e3-9b70-1806a697b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.298675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f596c9b-80cb-40e3-9b70-1806a697b8cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.299423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f596c9b-80cb-40e3-9b70-1806a697b8cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:06.299826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f596c9b-80cb-40e3-9b70-1806a697b8cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.301730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f596c9b-80cb-40e3-9b70-1806a697b8cf admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.320693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 922/1834] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:06.321645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3bea-3bc6-449f-8adf-4e671f0d6242 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.321934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3bea-3bc6-449f-8adf-4e671f0d6242 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.322234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda3bea-3bc6-449f-8adf-4e671f0d6242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.333193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.334725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.335414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.335957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.338872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:06.344045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-deda3bea-3bc6-449f-8adf-4e671f0d6242 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:06.345308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-deda3bea-3bc6-449f-8adf-4e671f0d6242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:06.357171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.357659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 923/1835] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:06.358960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd44f2-2f4a-470b-a017-203b6c631005 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.359240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd44f2-2f4a-470b-a017-203b6c631005 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.359442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.359546 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd44f2-2f4a-470b-a017-203b6c631005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.373811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 913/1836] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:06.374975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.383333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-23bd44f2-2f4a-470b-a017-203b6c631005 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:06.385032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-23bd44f2-2f4a-470b-a017-203b6c631005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:06.392557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e42af-126e-4f75-8211-d6d0d8312041 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.401443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 924/1837] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:06.403188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.403492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd44f2-2f4a-470b-a017-203b6c631005 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.404373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.404789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.405210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.405983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.408921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.417156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd44f2-2f4a-470b-a017-203b6c631005 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.423367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d8c3f-f619-4f23-a9ec-512b96fad354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.424286 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8c3f-f619-4f23-a9ec-512b96fad354 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.424793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8c3f-f619-4f23-a9ec-512b96fad354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.425234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d8c3f-f619-4f23-a9ec-512b96fad354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.426851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8c3f-f619-4f23-a9ec-512b96fad354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:06.427639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8c3f-f619-4f23-a9ec-512b96fad354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.429573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d8c3f-f619-4f23-a9ec-512b96fad354 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.449829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 925/1838] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:06.452346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befdab0-31a1-41f0-82f6-c6b10cc0e7b1 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.452707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befdab0-31a1-41f0-82f6-c6b10cc0e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.456424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 914/1839] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:06.456591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befdab0-31a1-41f0-82f6-c6b10cc0e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.456680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.481945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4befdab0-31a1-41f0-82f6-c6b10cc0e7b1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:06.485542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4befdab0-31a1-41f0-82f6-c6b10cc0e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:06.561186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0fbd6-15be-4579-8a34-471b25caeafc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.567196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.567737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.568081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.568181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 926/1840] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:06.568421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.569621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.571682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befdab0-31a1-41f0-82f6-c6b10cc0e7b1 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.572176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.582041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befdab0-31a1-41f0-82f6-c6b10cc0e7b1 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.588689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.589357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.589678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.589909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.590718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.592645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.606505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 915/1841] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:06.607627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.629783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 927/1842] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:06.630574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.640964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4f3a-9db3-4217-a74b-df2ceaae323a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.719387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.720054 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.720266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e70928-266e-45e1-bd2d-43826b3987e6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.720641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.720641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.721149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.723725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.727372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.728303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.728413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.728698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.729360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:06.729667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.731311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.747601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:06.756678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 916/1843] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:06.756678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.756956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 928/1844] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:06.761724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.773849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f7baf-ee12-491b-9fb6-fe011ffcdeae admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.778045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35318150-332d-4db5-91e3-6d168b087d63 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.782569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.783454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.783662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.783868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.784737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.785497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.787089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.787275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.787532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.787814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.788469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.794117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.811944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 917/1845] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:06.813166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.828450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89363ace-0390-4984-a1b7-17829dcb3a0f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.832187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 929/1846] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:06.833201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.834528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.835308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.836213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.838440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.839579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.843273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.844559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:06.863043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 918/1847] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:06.863903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.877052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfb637-56b3-40ce-8d89-7a539b55ac7a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.936152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70448c5-8a78-480f-9959-2a04c6a6087d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:06.941308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.941866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.942194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.942617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.943363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.946311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:06.978326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:06.979283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:06.983086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 930/1848] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:06.983229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:06.983229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:06.983420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:06.983513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:06.984579 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.008097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc00594-cf7b-4dbc-a764-0b0973d5d64b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.025051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.027757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 919/1849] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:06 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:07.028686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.029623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.030031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.030753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.032378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.035322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.048710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4dc99-6de1-42b5-b86c-f8ba899ee7a0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.055402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 931/1850] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:07.056600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.057392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.057769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.058085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] PATH_INFO: `/v3/projects/8756b535b956440896078b2a2eca20fd/users/8b31f265e90c4679975bf9b428f03842/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.064400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.077967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a67560-73c4-4e1f-ab15-5af2619eec04 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.083510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.084170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.084503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.084840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.085675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.087400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.087912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8756b535b956440896078b2a2eca20fd, user_id=8b31f265e90c4679975bf9b428f03842, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.091229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.103905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 932/1851] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:07.103905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.117865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 920/1852] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:07 2022] PUT /identity/v3/projects/8756b535b956440896078b2a2eca20fd/users/8b31f265e90c4679975bf9b428f03842/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:07.119167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439403c-6e8c-4bde-8a64-45d11007a753 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.119340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.224616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.225848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.227552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.227930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] PATH_INFO: `/v3/projects/f9750210a79541d7abb779e66a1b2dfc/users/0bb86117ca9b4cfd84b748500d1ce9d4/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.235073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89545256-3348-4fa9-b3fe-782dd582cd26 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.240497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15d9d3-9602-45d5-bacf-b7f6a4016fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.241124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15d9d3-9602-45d5-bacf-b7f6a4016fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.241406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15d9d3-9602-45d5-bacf-b7f6a4016fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.242205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15d9d3-9602-45d5-bacf-b7f6a4016fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.243061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15d9d3-9602-45d5-bacf-b7f6a4016fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.245020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15d9d3-9602-45d5-bacf-b7f6a4016fb8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.261189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9750210a79541d7abb779e66a1b2dfc, user_id=0bb86117ca9b4cfd84b748500d1ce9d4, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.264376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 921/1853] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:07.264376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055e4d-d87b-46d3-8732-1e74915d4103 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.264376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055e4d-d87b-46d3-8732-1e74915d4103 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.264376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055e4d-d87b-46d3-8732-1e74915d4103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.265459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.297217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 933/1854] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:07 2022] PUT /identity/v3/projects/f9750210a79541d7abb779e66a1b2dfc/users/0bb86117ca9b4cfd84b748500d1ce9d4/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:07.298570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.308559 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-37055e4d-d87b-46d3-8732-1e74915d4103 None None] MFA Rules not processed for user `8b31f265e90c4679975bf9b428f03842`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:07.309882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-37055e4d-d87b-46d3-8732-1e74915d4103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:07.348800 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:07.403195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6ef0d-f8aa-4541-9f85-cde0edd7f802 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.408915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 922/1855] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:07.412346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.413029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.414275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.414275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] PATH_INFO: `/v3/projects/900a61dee70b4b08a0f1f1ea2b187643/users/a327ea387c6f43f1ac9ad561c4278d22/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.416322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aebc0-a82b-47a2-906a-cf147ae3160c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.416606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aebc0-a82b-47a2-906a-cf147ae3160c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.425495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aebc0-a82b-47a2-906a-cf147ae3160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.437229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=900a61dee70b4b08a0f1f1ea2b187643, user_id=a327ea387c6f43f1ac9ad561c4278d22, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.440065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.442598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:07.460229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 934/1856] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:07 2022] PUT /identity/v3/projects/900a61dee70b4b08a0f1f1ea2b187643/users/a327ea387c6f43f1ac9ad561c4278d22/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:07.462105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.503178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c78aebc0-a82b-47a2-906a-cf147ae3160c None None] MFA Rules not processed for user `0bb86117ca9b4cfd84b748500d1ce9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:07.505056 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c78aebc0-a82b-47a2-906a-cf147ae3160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:07.597561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6005d8-30ea-4e09-ae61-48116017a1c4 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.610269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 923/1857] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:07.611513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae635d5-843c-4384-b4cc-ec18b81e2354 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.611798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae635d5-843c-4384-b4cc-ec18b81e2354 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.612074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae635d5-843c-4384-b4cc-ec18b81e2354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.614181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.615040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.615499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.615976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.616865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.619884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.662454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 935/1858] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:07.666807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.673866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fae635d5-843c-4384-b4cc-ec18b81e2354 None None] MFA Rules not processed for user `a327ea387c6f43f1ac9ad561c4278d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:07.676625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fae635d5-843c-4384-b4cc-ec18b81e2354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:07.767305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd9b9f-70c3-404d-83b0-e2181d2c9c34 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.779362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.780774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.781147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.781534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.782394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.785022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.805221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 924/1859] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:07.806669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae635d5-843c-4384-b4cc-ec18b81e2354 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.823810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae635d5-843c-4384-b4cc-ec18b81e2354 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.830496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.831310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.831591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.831862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.832495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.834878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.834995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 936/1860] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:07.836412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.861933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 925/1861] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:07.865913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.878780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839dfbd-f905-4644-8acf-44056687be8b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.904753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:07.908965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea8e91-84e0-481b-bd2d-e7a6f9dacf09 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:07.914037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:07.916853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.918092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.918461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.920420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.920420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.922248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.950861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:07.951586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:07.952232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:07.952560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:07.953335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:07.955452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:07.956623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 937/1862] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:07.957488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:07.990682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 926/1863] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:07.991618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.003723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102033b9-97bb-428d-99a4-1529850374e5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.056024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1eae-b393-4717-81f1-88e53f9b6c54 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.060723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.061331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.061607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.061879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.062547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.064160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.064392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.065076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.065481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.065764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.066639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.068603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.075167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 938/1864] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:08.075967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.077577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:08.092601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 927/1865] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:07 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:08.093552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.103641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1701082-8d9a-4afe-9720-580cf0fee4d7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.108674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.109403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.109665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.109934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.110602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.112216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.122522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 928/1866] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:08.123304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.133431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1b9ad-fcb7-4354-8585-ab9a2f9677e6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.137523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32181041-8f8c-4b60-aa18-3d7da5bee021 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.138348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.139076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.139356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.139623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] PATH_INFO: `/v3/projects/9a432e681eef4537b5356fd7aff894d7/users/43d61716f4064a28ae3314cdb085bc3f/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.141721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.142247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.142537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.142810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.144598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:08.154909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a432e681eef4537b5356fd7aff894d7, user_id=43d61716f4064a28ae3314cdb085bc3f, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.157518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.171808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 929/1867] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:08 2022] PUT /identity/v3/projects/9a432e681eef4537b5356fd7aff894d7/users/43d61716f4064a28ae3314cdb085bc3f/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:08.172988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.211035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.212584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.228129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 939/1868] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:08.228969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.235505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275d57c-a9de-4d5c-a2ff-8985f63f2058 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.240073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc160b49-bc26-4852-b7c0-f6c47b5c8906 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.240520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.241343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.242367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.242893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.243630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.245301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.246338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.247003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.247268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.247537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] PATH_INFO: `/v3/projects/235b3ba7c31c4cb6969720202e331fa5/users/bcc14f0ffe294f9bbf313a9e797bb474/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.256291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 930/1869] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:08.257243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.264148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=235b3ba7c31c4cb6969720202e331fa5, user_id=bcc14f0ffe294f9bbf313a9e797bb474, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.266926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.271220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927d2e0-31a4-4267-a1a3-f798792027be admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.277109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.278450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.278919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.279279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.280327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.282280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.285678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 940/1870] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:08 2022] PUT /identity/v3/projects/235b3ba7c31c4cb6969720202e331fa5/users/bcc14f0ffe294f9bbf313a9e797bb474/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:08.285678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.289662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:08.292240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:08.298218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 931/1871] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:08.300208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.313749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c17c76-cf59-44f1-8c32-396d450b8347 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.377966 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461b589-f763-4318-a52e-ae22c7eb32ea admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.386690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.387784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.388449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.388897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] PATH_INFO: `/v3/projects/7a17acb934db43a19a04a7cd25f348c2/users/59e2dd10aced4d32a5c462cb05a56181/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.403463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.404197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.404747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.405147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.405864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.407581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.408449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a17acb934db43a19a04a7cd25f348c2, user_id=59e2dd10aced4d32a5c462cb05a56181, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.411666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.422516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 932/1872] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:08.423762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.434275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 941/1873] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:08 2022] PUT /identity/v3/projects/7a17acb934db43a19a04a7cd25f348c2/users/59e2dd10aced4d32a5c462cb05a56181/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:08.435185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.452598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa99f8f-2904-4342-8ee0-07746b28d5f9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.583795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95724-5717-40c9-980b-c88faab3c950 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.590237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.591857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.592138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.592753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] PATH_INFO: `/v3/projects/235b3ba7c31c4cb6969720202e331fa5/users/bcc14f0ffe294f9bbf313a9e797bb474/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.594707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=235b3ba7c31c4cb6969720202e331fa5, user_id=bcc14f0ffe294f9bbf313a9e797bb474, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.597516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.636054 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 942/1874] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:08 2022] PUT /identity/v3/projects/235b3ba7c31c4cb6969720202e331fa5/users/bcc14f0ffe294f9bbf313a9e797bb474/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:08.637251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.644102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbba607-e1c1-43ea-bde5-58d6d6e9752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.644794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba607-e1c1-43ea-bde5-58d6d6e9752b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.645083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba607-e1c1-43ea-bde5-58d6d6e9752b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.645362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbba607-e1c1-43ea-bde5-58d6d6e9752b admin admin] PATH_INFO: `/v3/projects/9a432e681eef4537b5356fd7aff894d7/users/43d61716f4064a28ae3314cdb085bc3f/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.647404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbba607-e1c1-43ea-bde5-58d6d6e9752b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a432e681eef4537b5356fd7aff894d7, user_id=43d61716f4064a28ae3314cdb085bc3f, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.650317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbba607-e1c1-43ea-bde5-58d6d6e9752b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.692748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 933/1875] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:08 2022] PUT /identity/v3/projects/9a432e681eef4537b5356fd7aff894d7/users/43d61716f4064a28ae3314cdb085bc3f/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:08.694184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764595b8-84f0-4c37-a535-f814b608e8ea None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.694476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764595b8-84f0-4c37-a535-f814b608e8ea None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.694854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764595b8-84f0-4c37-a535-f814b608e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.759666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-764595b8-84f0-4c37-a535-f814b608e8ea None None] MFA Rules not processed for user `bcc14f0ffe294f9bbf313a9e797bb474`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:08.760910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-764595b8-84f0-4c37-a535-f814b608e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:08.791514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d9da8-e6ef-4d27-89a8-97c9d59b02aa admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:08.837461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:08.885565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:08.886498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.887445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.888426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.890233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:08.892702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:08.895286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 934/1876] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:08.897207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:08.899208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:08.899678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:08.922033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 943/1877] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:08.923756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:08.952775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] MFA Rules not processed for user `43d61716f4064a28ae3314cdb085bc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:08.954300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:08.959903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:09.034978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337aa900-cc36-41d1-af99-69a5c6890f9f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:09.039538 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:09.040474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.040873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.041226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.057901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:09.059936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:09.079797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 944/1878] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:09.080654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:09.092605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703935f-5362-48a1-8920-46b498da73db service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:09.097594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:09.098304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.098591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.098869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] PATH_INFO: `/v3/projects/7a17acb934db43a19a04a7cd25f348c2/users/59e2dd10aced4d32a5c462cb05a56181/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.101898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a17acb934db43a19a04a7cd25f348c2, user_id=59e2dd10aced4d32a5c462cb05a56181, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:09.103542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 935/1879] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:09.104689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:09.104824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:09.111985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:09.147099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 945/1880] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:09 2022] PUT /identity/v3/projects/7a17acb934db43a19a04a7cd25f348c2/users/59e2dd10aced4d32a5c462cb05a56181/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:09.148279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:09.149380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4da065-12ee-40c4-9323-e7c681489dc2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:09.234485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a8ae-59f8-4795-a3bc-9765e3ff8bd6 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:09.240657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:09.241892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.242943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.243386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] PATH_INFO: `/v3/users/0bb86117ca9b4cfd84b748500d1ce9d4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.245613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb86117ca9b4cfd84b748500d1ce9d4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:09.248213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:09.268098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85356a-23fe-4693-af42-0caf7d3efada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:09.270458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85356a-23fe-4693-af42-0caf7d3efada service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.270902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85356a-23fe-4693-af42-0caf7d3efada service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.272993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85356a-23fe-4693-af42-0caf7d3efada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.365331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb86117ca9b4cfd84b748500d1ce9d4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:09.380808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb86117ca9b4cfd84b748500d1ce9d4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:09.383139 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb86117ca9b4cfd84b748500d1ce9d4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:09.387262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:09.406643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb86117ca9b4cfd84b748500d1ce9d4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:09.407370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2db6ac74-b5da-43cc-8a94-97d94ba265ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb86117ca9b4cfd84b748500d1ce9d4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:09.430797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 946/1881] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:09 2022] DELETE /identity/v3/users/0bb86117ca9b4cfd84b748500d1ce9d4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:09.432674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.433024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.433574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.457786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85356a-23fe-4693-af42-0caf7d3efada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:09.463500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85356a-23fe-4693-af42-0caf7d3efada service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:09.475628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] MFA Rules not processed for user `59e2dd10aced4d32a5c462cb05a56181`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:09.478355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:09.494353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 936/1882] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:09.498693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.499139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.499746 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.547075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:09.552892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:09.615228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 947/1883] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:09.625693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:09.627396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:09.628262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:09.646037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 937/1884] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:09.662075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:09.664277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:09.697621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342ab8b-7307-47d2-ad0e-63f7a6c6442d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:09.706887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:09.707529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.707823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.708079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.715437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:09.759191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815249-ceb7-497c-93a0-99affe29fe1a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:09.763942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:09.764666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:09.765010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:09.765122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:09.797901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:09.799764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:09.826773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 938/1885] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:09.857111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:09.860137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:09.876136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 948/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:10.192356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:10.195972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:10.393969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88581-13d7-45a8-87f7-5c41f98cbe21 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:10.402821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d61716f4064a28ae3314cdb085bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a432e681eef4537b5356fd7aff894d7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:10.403658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:10.404220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:10.404541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:10.405327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:10.405874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:10.407968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:10.429992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 939/1887] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:10.431356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:10.443336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b357223-0847-4cc7-8b4d-5e6d4f7664db service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:10.448499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d61716f4064a28ae3314cdb085bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a432e681eef4537b5356fd7aff894d7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:10.449117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:10.449399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:10.449675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:10.450347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:10.452257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:10.471808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:10.495461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 949/1888] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:10 2022] POST /identity/v3/projects => generated 352 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:10.500277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:10.513381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b80fe7-8a64-4320-a8db-12ea5f69af3b tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:10.595436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d61716f4064a28ae3314cdb085bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a432e681eef4537b5356fd7aff894d7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:10.596111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:10.596499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:10.596791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:10.597576 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:10.597881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:10.599500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:10.616890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 940/1889] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:29:10.650401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:10.652531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:10.661829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:10.679848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e992-e1c0-44cf-94e8-41b29ef770e3 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:10.701695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d61716f4064a28ae3314cdb085bc3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a432e681eef4537b5356fd7aff894d7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:10.702377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:10.702826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:10.702989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] PATH_INFO: `/v3/projects/71c66658f44f4393ac8e5dffc60be65a` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:10.704167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorizing `identity:delete_project(project_id=71c66658f44f4393ac8e5dffc60be65a)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:10.707357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:10.735003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:10.766499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc274e-15d2-4722-b8c9-587af81829c9 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:10.779136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c66658f44f4393ac8e5dffc60be65a', 'request_id': 'req-b8053fb4-829a-4188-8615-57f70ef62a83'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.793734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c66658f44f4393ac8e5dffc60be65a', 'request_id': 'req-b8053fb4-829a-4188-8615-57f70ef62a83'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.803744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c66658f44f4393ac8e5dffc60be65a', 'request_id': 'req-b8053fb4-829a-4188-8615-57f70ef62a83'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.817273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] The token cache is being invalidate because project 71c66658f44f4393ac8e5dffc60be65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:10.817567 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.818334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.823629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 941/1890] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:10 2022] DELETE /identity/v3/projects/71c66658f44f4393ac8e5dffc60be65a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:10.842886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:10.843781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:10.844205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:10.844620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] PATH_INFO: `/v3/projects/f9750210a79541d7abb779e66a1b2dfc` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:10.845969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9750210a79541d7abb779e66a1b2dfc)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:10.848489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:10.908632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9750210a79541d7abb779e66a1b2dfc', 'request_id': 'req-223f405e-52a3-46ca-abfc-27a7b947dc97'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.915492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9750210a79541d7abb779e66a1b2dfc', 'request_id': 'req-223f405e-52a3-46ca-abfc-27a7b947dc97'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.923540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9750210a79541d7abb779e66a1b2dfc', 'request_id': 'req-223f405e-52a3-46ca-abfc-27a7b947dc97'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.936677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] The token cache is being invalidate because project f9750210a79541d7abb779e66a1b2dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:10.936974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.937628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:10.939240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 950/1891] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:10 2022] DELETE /identity/v3/projects/f9750210a79541d7abb779e66a1b2dfc => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:10.943372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:10.947447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:10.970026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8053fb4-829a-4188-8615-57f70ef62a83 tempest-VolumeQuotaClassesTest-1663973085 tempest-VolumeQuotaClassesTest-1663973085-project-admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:11.035559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:11.037051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:11.060245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:11.061046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.061327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.061606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] PATH_INFO: `/v3/users/bcc14f0ffe294f9bbf313a9e797bb474` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.065506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc14f0ffe294f9bbf313a9e797bb474)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:11.068704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:11.084051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:11.153021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f405e-52a3-46ca-abfc-27a7b947dc97 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:11.160928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:11.161583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.161942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.162283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] PATH_INFO: `/v3/users/8b31f265e90c4679975bf9b428f03842` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.163668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b31f265e90c4679975bf9b428f03842)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:11.165696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:11.166881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc14f0ffe294f9bbf313a9e797bb474'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.167733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc14f0ffe294f9bbf313a9e797bb474'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.168358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc14f0ffe294f9bbf313a9e797bb474'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.176264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc14f0ffe294f9bbf313a9e797bb474'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.186407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c835d3e-265a-4447-8e67-1388d3e30837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc14f0ffe294f9bbf313a9e797bb474'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.206537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 942/1892] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:10 2022] DELETE /identity/v3/users/bcc14f0ffe294f9bbf313a9e797bb474 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:11.223051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b31f265e90c4679975bf9b428f03842'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.233083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b31f265e90c4679975bf9b428f03842'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.234832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b31f265e90c4679975bf9b428f03842'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.244147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b31f265e90c4679975bf9b428f03842'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.244976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b31f265e90c4679975bf9b428f03842'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.270402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 951/1893] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:11 2022] DELETE /identity/v3/users/8b31f265e90c4679975bf9b428f03842 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:11.278708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791e63-6bf0-4e76-ab1a-5d843edd76a0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.279224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791e63-6bf0-4e76-ab1a-5d843edd76a0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.279651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791e63-6bf0-4e76-ab1a-5d843edd76a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.307593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-25791e63-6bf0-4e76-ab1a-5d843edd76a0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:11.308927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-25791e63-6bf0-4e76-ab1a-5d843edd76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:11.332048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:11.390849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 943/1894] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:11.403641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:11.406145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:11.487903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7693518-3f4c-4d80-9ce5-7f1e4eb1e6fb admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:11.492808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:11.493569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.497875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.498345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.518557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2675d-a5bb-4911-9d5f-8c4c3d0d8fc2 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.518557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2675d-a5bb-4911-9d5f-8c4c3d0d8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.518557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2675d-a5bb-4911-9d5f-8c4c3d0d8fc2 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.521736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 944/1895] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:29:11.522986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:11.525835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:11.541016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5550-69af-4ea0-a038-36e79c94ef7b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.541324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5550-69af-4ea0-a038-36e79c94ef7b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.541599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda5550-69af-4ea0-a038-36e79c94ef7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.549931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 952/1896] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:11.550815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:11.555433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:11.578950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3dda5550-69af-4ea0-a038-36e79c94ef7b None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:11.580177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3dda5550-69af-4ea0-a038-36e79c94ef7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:11.586482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da331a45-8fdc-4df6-a630-107754e0e9e1 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:11.593229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:11.594090 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.594377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.594650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] PATH_INFO: `/v3/projects/235b3ba7c31c4cb6969720202e331fa5` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.601680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235b3ba7c31c4cb6969720202e331fa5)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:11.603724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:11.723499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:11.739214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235b3ba7c31c4cb6969720202e331fa5', 'request_id': 'req-e5278d7a-b025-45f1-b8e5-fe4525621ea7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.757594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235b3ba7c31c4cb6969720202e331fa5', 'request_id': 'req-e5278d7a-b025-45f1-b8e5-fe4525621ea7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.777886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235b3ba7c31c4cb6969720202e331fa5', 'request_id': 'req-e5278d7a-b025-45f1-b8e5-fe4525621ea7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.798485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 945/1897] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:29:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:11.800434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] The token cache is being invalidate because project 235b3ba7c31c4cb6969720202e331fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:11.800742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.801456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5278d7a-b025-45f1-b8e5-fe4525621ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:11.806709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 953/1898] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:11 2022] DELETE /identity/v3/projects/235b3ba7c31c4cb6969720202e331fa5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:11.808702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd52b0-f8db-4032-8f71-86debc83a7f7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:11.809169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd52b0-f8db-4032-8f71-86debc83a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:11.809636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd52b0-f8db-4032-8f71-86debc83a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:11.839952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b5fd52b0-f8db-4032-8f71-86debc83a7f7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:11.841903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5fd52b0-f8db-4032-8f71-86debc83a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.035843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 946/1899] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:12.044659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119213f0-8f1e-4086-a594-24344f16137c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.044659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119213f0-8f1e-4086-a594-24344f16137c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.045312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119213f0-8f1e-4086-a594-24344f16137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.081140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-119213f0-8f1e-4086-a594-24344f16137c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:12.082405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-119213f0-8f1e-4086-a594-24344f16137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.095323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 954/1900] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:12.100307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd52b0-f8db-4032-8f71-86debc83a7f7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.114420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd52b0-f8db-4032-8f71-86debc83a7f7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.121314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.121935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.122248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.122519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.123177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:12.123543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.125075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.144474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 947/1901] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:12.147380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119213f0-8f1e-4086-a594-24344f16137c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.158066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119213f0-8f1e-4086-a594-24344f16137c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.164814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.165709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.166102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.166464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.167181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.169450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.206084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 955/1902] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:12 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:12.208702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.220636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2de85-1bef-4f19-b02c-3030b9c8a594 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.269343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:12.290448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.291716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.303835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.304734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.305390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.305763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.306560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.308674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.354601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 948/1903] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:12 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:12.356351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.369011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce465c-3b9b-4682-a087-fd8676cce8ca admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.374375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.375009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.375291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.375564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.376218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.378062 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.392032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 949/1904] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:12.395699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.424228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448ddc-3215-4adf-b881-1fcb706fea2e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.426199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ce17d-688a-46d7-905a-aa0fbd63414a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.431748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.432646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.433278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.433461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.433588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.434024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.434528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.435052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.435788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.436312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.438531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.454862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.459230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.461893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 950/1905] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:12.463175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.478023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726da68f-0a05-4c31-aee7-8ddc8f431ade admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.490969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063deea1-351d-4e64-88f7-2c1c26fb759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.492215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063deea1-351d-4e64-88f7-2c1c26fb759c admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.492329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063deea1-351d-4e64-88f7-2c1c26fb759c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.492558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063deea1-351d-4e64-88f7-2c1c26fb759c admin admin] PATH_INFO: `/v3/projects/722736cb94fc43f2aa293555ed4904ee/users/773b3f7d27ec45998c94a158deb27aa5/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.493590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 956/1906] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:12.515792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.527912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.531003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063deea1-351d-4e64-88f7-2c1c26fb759c admin admin] RBAC: Authorizing `identity:create_grant(project_id=722736cb94fc43f2aa293555ed4904ee, user_id=773b3f7d27ec45998c94a158deb27aa5, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.542802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063deea1-351d-4e64-88f7-2c1c26fb759c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.562507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaef4bb-9080-453b-a6dc-471f7dfc6dd1 service nova] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.574402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 951/1907] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:12 2022] PUT /identity/v3/projects/722736cb94fc43f2aa293555ed4904ee/users/773b3f7d27ec45998c94a158deb27aa5/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:12.585976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173bf4b-09c9-48c4-9507-82a46f98d69f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.586543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173bf4b-09c9-48c4-9507-82a46f98d69f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.586973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173bf4b-09c9-48c4-9507-82a46f98d69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.631853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3173bf4b-09c9-48c4-9507-82a46f98d69f None None] MFA Rules not processed for user `773b3f7d27ec45998c94a158deb27aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:12.633477 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3173bf4b-09c9-48c4-9507-82a46f98d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.693658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.694404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.694834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.695319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] PATH_INFO: `/v3/projects/8756b535b956440896078b2a2eca20fd` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.697314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8756b535b956440896078b2a2eca20fd)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.699291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.742249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 952/1908] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:12.746636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173bf4b-09c9-48c4-9507-82a46f98d69f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.765238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173bf4b-09c9-48c4-9507-82a46f98d69f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.778515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:12.779823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.780976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.781410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.781877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.783822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.790811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.798399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8756b535b956440896078b2a2eca20fd', 'request_id': 'req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:12.820226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8756b535b956440896078b2a2eca20fd', 'request_id': 'req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:12.828918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8756b535b956440896078b2a2eca20fd', 'request_id': 'req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:12.837503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 953/1909] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:12 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:12.838945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.843493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] The token cache is being invalidate because project 8756b535b956440896078b2a2eca20fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:12.843841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:12.844507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:12.846199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 957/1910] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:12 2022] DELETE /identity/v3/projects/8756b535b956440896078b2a2eca20fd => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:12.849952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.851772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.903270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:12.908374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc35a1-7ed4-440e-9b15-1a22be695397 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.916117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.917244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.917244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.917417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.918250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.920053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.930848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f557b7b-ad28-40f9-a4a7-cc58b65dad22 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.936940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.937801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.938188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.938470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] PATH_INFO: `/v3/users/43d61716f4064a28ae3314cdb085bc3f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.939827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d61716f4064a28ae3314cdb085bc3f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.941796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:12.951928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 954/1911] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:12 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:12.954046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:12.956313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:12.983818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2454e4-687f-48f7-9160-c510e521ba2e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:12.989999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:12.990741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:12.991095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:12.992175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:12.993168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:12.995193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:13.018482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 955/1912] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:13.018482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:13.021117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.028523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d61716f4064a28ae3314cdb085bc3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.037951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d61716f4064a28ae3314cdb085bc3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.040011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d61716f4064a28ae3314cdb085bc3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.049726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8185d-0c8a-4548-ac1b-a9ad3eae2716 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:13.054550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d61716f4064a28ae3314cdb085bc3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.055339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d61716f4064a28ae3314cdb085bc3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.057200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:13.058028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.058520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.058860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] PATH_INFO: `/v3/users/a327ea387c6f43f1ac9ad561c4278d22` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.060226 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a327ea387c6f43f1ac9ad561c4278d22)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:13.064840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:13.080684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 958/1913] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:12 2022] DELETE /identity/v3/users/43d61716f4064a28ae3314cdb085bc3f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:13.081581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:13.096095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.157733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a327ea387c6f43f1ac9ad561c4278d22'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.158552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a327ea387c6f43f1ac9ad561c4278d22'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.159221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a327ea387c6f43f1ac9ad561c4278d22'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.174964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a327ea387c6f43f1ac9ad561c4278d22'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.191415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b410382-3cbd-4f55-98bb-5fd3593b2559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a327ea387c6f43f1ac9ad561c4278d22'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:13.238300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 956/1914] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:13 2022] DELETE /identity/v3/users/a327ea387c6f43f1ac9ad561c4278d22 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:13.244038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.244392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.244679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.260168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:13.294581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:13.296612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.314964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974612-fdde-4a99-b46c-c52644849517 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:13.429449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:13.430447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.430699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.430977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] PATH_INFO: `/v3/projects/4130b7f7a6ac4cbabf2fca5a64481f4e/users/d822c2d4697b4ba6b5c7cf5c0a83ed50/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.446260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 957/1915] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:13.449340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4130b7f7a6ac4cbabf2fca5a64481f4e, user_id=d822c2d4697b4ba6b5c7cf5c0a83ed50, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:13.453033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:13.477660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 959/1916] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:13 2022] PUT /identity/v3/projects/4130b7f7a6ac4cbabf2fca5a64481f4e/users/d822c2d4697b4ba6b5c7cf5c0a83ed50/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:13.478976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:13.480847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.496128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e5113-044c-4a3e-b797-f5d94850f66b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:13.519486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:13.521313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.570958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:13.604542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:13.605482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.607467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.607769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.610523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:13.612369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:13.651557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 958/1917] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:13.651557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:13.654689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8f36a-9da6-40cb-af66-dd2837a8b483 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:13.666916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:13.667718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.667830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.668091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.669684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d6620-fccf-4f6b-b880-0931854c4a21 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:13.681920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef969d-ec77-4121-881e-d48b15502c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:13.682725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef969d-ec77-4121-881e-d48b15502c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.682913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef969d-ec77-4121-881e-d48b15502c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.683175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef969d-ec77-4121-881e-d48b15502c0d admin admin] PATH_INFO: `/v3/projects/4130b7f7a6ac4cbabf2fca5a64481f4e/users/d822c2d4697b4ba6b5c7cf5c0a83ed50/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.689367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef969d-ec77-4121-881e-d48b15502c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4130b7f7a6ac4cbabf2fca5a64481f4e, user_id=d822c2d4697b4ba6b5c7cf5c0a83ed50, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:13.692108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef969d-ec77-4121-881e-d48b15502c0d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:13.701652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:13.704303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:13.718031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 959/1918] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:13 2022] PUT /identity/v3/projects/4130b7f7a6ac4cbabf2fca5a64481f4e/users/d822c2d4697b4ba6b5c7cf5c0a83ed50/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:13.720724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 960/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:13.730528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.730812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.731091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.795546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] MFA Rules not processed for user `d822c2d4697b4ba6b5c7cf5c0a83ed50`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:13.797053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.819930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:13.821571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.848796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3021f3-14b4-4926-afd7-e4196e0b62a2 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:13.945329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 960/1920] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:13.958967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:13.960968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:13.988137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:13.988898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:13.989248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:13.989615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] PATH_INFO: `/v3/projects/9a432e681eef4537b5356fd7aff894d7` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:13.991789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a432e681eef4537b5356fd7aff894d7)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:13.997605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.034825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:14.096127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62fa95-a94e-4426-afb0-cb872775e22e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:14.108948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a432e681eef4537b5356fd7aff894d7', 'request_id': 'req-4b920853-c377-4c18-b151-129b6a7e34ce'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.125057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a432e681eef4537b5356fd7aff894d7', 'request_id': 'req-4b920853-c377-4c18-b151-129b6a7e34ce'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.139828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a432e681eef4537b5356fd7aff894d7', 'request_id': 'req-4b920853-c377-4c18-b151-129b6a7e34ce'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.153689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] The token cache is being invalidate because project 9a432e681eef4537b5356fd7aff894d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:14.154011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.154730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4b920853-c377-4c18-b151-129b6a7e34ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.156813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 961/1921] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:13 2022] DELETE /identity/v3/projects/9a432e681eef4537b5356fd7aff894d7 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:14.161289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5dae-0228-42d5-a901-be9e696e7d0e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.161699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5dae-0228-42d5-a901-be9e696e7d0e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.162098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5dae-0228-42d5-a901-be9e696e7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.188051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-692a5dae-0228-42d5-a901-be9e696e7d0e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:14.190689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-692a5dae-0228-42d5-a901-be9e696e7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:14.226383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:14.227316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.227316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.227526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.229305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:14.266091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:14.276447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 962/1922] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:14.280811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcc13e-1a90-481f-9274-60abe150d73a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.282147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcc13e-1a90-481f-9274-60abe150d73a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.282604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcc13e-1a90-481f-9274-60abe150d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.310922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9ffcc13e-1a90-481f-9274-60abe150d73a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:14.312162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9ffcc13e-1a90-481f-9274-60abe150d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:14.324377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 963/1923] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:14.325251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcc13e-1a90-481f-9274-60abe150d73a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:14.333965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:14.336599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.347544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 961/1924] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:14.352396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:14.353924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:14.354385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffcc13e-1a90-481f-9274-60abe150d73a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:14.369666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b998dcf-b632-4d30-8f25-0ee760d0714b service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:14.370439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:14.371175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.371458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.371731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.372384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:14.372691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:14.374341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.376028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:14.376989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.377458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.377934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] PATH_INFO: `/v3/projects/900a61dee70b4b08a0f1f1ea2b187643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.379275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=900a61dee70b4b08a0f1f1ea2b187643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:14.381280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.404144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 964/1925] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:14.418447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:14.438111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7517a9-665e-4337-adaa-05947b15ea7b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:14.450645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:14.451267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.452874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.453299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.453904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:14.459415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.472986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '900a61dee70b4b08a0f1f1ea2b187643', 'request_id': 'req-ab3c43b0-b773-42a1-a723-160f8bbff481'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.507351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '900a61dee70b4b08a0f1f1ea2b187643', 'request_id': 'req-ab3c43b0-b773-42a1-a723-160f8bbff481'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.516043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '900a61dee70b4b08a0f1f1ea2b187643', 'request_id': 'req-ab3c43b0-b773-42a1-a723-160f8bbff481'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.525897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 965/1926] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:14 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:14.527664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:14.532689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] The token cache is being invalidate because project 900a61dee70b4b08a0f1f1ea2b187643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:14.533835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.534752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.536723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 962/1927] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:14 2022] DELETE /identity/v3/projects/900a61dee70b4b08a0f1f1ea2b187643 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:14.544809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:14.546834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:14.666612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1afd2-6f7a-4387-80e1-05d0965f65cd admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:14.674678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:14.675246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.675636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.675983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.676910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:14.684951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.697897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:14.724584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 966/1928] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:14 2022] POST /identity/v3/users => generated 284 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:14.725283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:14.729061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c43b0-b773-42a1-a723-160f8bbff481 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:14.731341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:14.743443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:14.743927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.744214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.745114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] PATH_INFO: `/v3/users/59e2dd10aced4d32a5c462cb05a56181` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.747082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e2dd10aced4d32a5c462cb05a56181)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:14.751300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.761181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcfed6-944f-4ebd-a137-395440afcc1e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:14.778072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:14.778724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:14.779555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:14.779902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] PATH_INFO: `/v3/users/773b3f7d27ec45998c94a158deb27aa5` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:14.781672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773b3f7d27ec45998c94a158deb27aa5)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:14.785664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:14.900832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773b3f7d27ec45998c94a158deb27aa5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.914730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:14.918887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e2dd10aced4d32a5c462cb05a56181'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.920265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e2dd10aced4d32a5c462cb05a56181'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.922144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773b3f7d27ec45998c94a158deb27aa5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.923315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773b3f7d27ec45998c94a158deb27aa5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.930345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e2dd10aced4d32a5c462cb05a56181'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.942444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e2dd10aced4d32a5c462cb05a56181'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.945863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773b3f7d27ec45998c94a158deb27aa5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.948367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773b3f7d27ec45998c94a158deb27aa5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.964157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-95790a61-7e2e-4256-a868-f369f72bcb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e2dd10aced4d32a5c462cb05a56181'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:14.988206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 967/1929] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:14 2022] DELETE /identity/v3/users/773b3f7d27ec45998c94a158deb27aa5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:14.993280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:14.996202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:15.012609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 963/1930] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:14 2022] DELETE /identity/v3/users/59e2dd10aced4d32a5c462cb05a56181 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:15.012609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.012609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.012609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.038706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:15.040475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:15.136731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1bd0-6757-4923-bd59-cda18c68be98 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.152519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 964/1931] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:15.156662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:15.157294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.157570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.157839 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.158528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:15.160309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:15.165880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:15.167533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:15.182498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 968/1932] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:15.183460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:15.213526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902fa7f-9146-4a03-b8c8-6b217d121cd4 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.223709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:15.224431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.224856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.225259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.226808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:15.228504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:15.241686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 969/1933] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:15.246109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:15.265506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e404a6b-d655-4751-86b6-b381bbadd5cf admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.273448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d50e9-1036-4011-be63-2e71b46bef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:15.274226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d50e9-1036-4011-be63-2e71b46bef4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.274665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d50e9-1036-4011-be63-2e71b46bef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.274950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d50e9-1036-4011-be63-2e71b46bef4c admin admin] PATH_INFO: `/v3/projects/9a6545956163482b9fdfd1a86f71e3bd/users/4bad3b4f09f34ef08f6df9c2fbdde576/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.280718 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1f581-376a-44f9-bada-ea60192d9409 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.286846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:15.287586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.292853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.293193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.297018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d50e9-1036-4011-be63-2e71b46bef4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6545956163482b9fdfd1a86f71e3bd, user_id=4bad3b4f09f34ef08f6df9c2fbdde576, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:15.302369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d50e9-1036-4011-be63-2e71b46bef4c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:15.328303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:15.329851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:15.337970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 970/1934] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:15 2022] PUT /identity/v3/projects/9a6545956163482b9fdfd1a86f71e3bd/users/4bad3b4f09f34ef08f6df9c2fbdde576/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:15.339919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.340205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.340542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.358397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 965/1935] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:15.424008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] MFA Rules not processed for user `4bad3b4f09f34ef08f6df9c2fbdde576`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:15.425319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:15.455342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:15.554776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 971/1936] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:15.559110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:15.573378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1ec6f-26df-4b46-81e0-1da424cdba2a service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.681458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:15.681458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.681458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.681458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.682429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:15.685080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:15.712939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:15.717859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:15.725023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:15.751142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847d33b-85eb-4a3e-b3eb-91a2c81b2d62 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.757213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 966/1937] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:15 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:15.761963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:15.763437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:15.766380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.766672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.766954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] PATH_INFO: `/v3/projects/7a17acb934db43a19a04a7cd25f348c2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.770603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a17acb934db43a19a04a7cd25f348c2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:15.776646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:15.863285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4d3e6-27b1-410e-84a1-600a52ebfada admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.870504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:15.871508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:15.872076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:15.872529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:15.874616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:15.877003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:15.939371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 967/1938] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:15 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:15.943322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:15.953619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a17acb934db43a19a04a7cd25f348c2', 'request_id': 'req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:15.970561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a17acb934db43a19a04a7cd25f348c2', 'request_id': 'req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:15.971326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51eb3e-d8b0-45c4-80d8-ed427f53f78e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:15.988901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a17acb934db43a19a04a7cd25f348c2', 'request_id': 'req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.035675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] The token cache is being invalidate because project 7a17acb934db43a19a04a7cd25f348c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:16.035994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.038594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-0a5ea2bb-0e81-42cd-87bc-13af4c4e3670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.042276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 972/1939] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:15 2022] DELETE /identity/v3/projects/7a17acb934db43a19a04a7cd25f348c2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:16.050598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.050735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.051069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.107354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:16.110769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.166443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.169459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.170193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.171884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.172740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.178096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.198611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 968/1940] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:16.219071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.227232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.260595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62fecb-ae5f-4964-993e-314fff17a24b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.270523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 973/1941] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:16.274611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.274690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66791b63-7a10-4ee0-a802-33f556b65307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.274826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.274903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66791b63-7a10-4ee0-a802-33f556b65307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.274903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66791b63-7a10-4ee0-a802-33f556b65307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.274903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66791b63-7a10-4ee0-a802-33f556b65307 admin admin] PATH_INFO: `/v3/projects/0742aeda811f4c558dc363283b25c894/users/0dff6aaebf464af9a1decef8de7e135b/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.291685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839df2e9-579e-4922-866a-55599c6e9947 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.297287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.297928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.298372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.298651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] PATH_INFO: `/v3/projects/722736cb94fc43f2aa293555ed4904ee` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.298770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66791b63-7a10-4ee0-a802-33f556b65307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0742aeda811f4c558dc363283b25c894, user_id=0dff6aaebf464af9a1decef8de7e135b, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.300008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=722736cb94fc43f2aa293555ed4904ee)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.302158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.302416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66791b63-7a10-4ee0-a802-33f556b65307 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.327159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 969/1942] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:16 2022] PUT /identity/v3/projects/0742aeda811f4c558dc363283b25c894/users/0dff6aaebf464af9a1decef8de7e135b/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:16.328174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.331049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.331781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.357507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:16.358642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.375748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:16.394410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722736cb94fc43f2aa293555ed4904ee', 'request_id': 'req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.419289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722736cb94fc43f2aa293555ed4904ee', 'request_id': 'req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.430619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722736cb94fc43f2aa293555ed4904ee', 'request_id': 'req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.456149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] The token cache is being invalidate because project 722736cb94fc43f2aa293555ed4904ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:16.457329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.458494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.461694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 974/1943] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:16 2022] DELETE /identity/v3/projects/722736cb94fc43f2aa293555ed4904ee => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:16.464972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.466875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.467530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:16.500916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 970/1944] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:16.501951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.504594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.529979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eaf6f-1624-4f54-bdea-a33a0970bde8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.568767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a240-2ade-4ac9-b18a-32bc26d56d3f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.587249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.588103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.589704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.589998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.592159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.595119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.609655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 975/1945] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:16.610372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.621922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5d47-d33f-4181-85a8-3a969f613653 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.627186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.627452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.627802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.628147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.628867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:16.629466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.631400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.656744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 976/1946] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:16.657423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.660602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.662324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.662898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.663640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] PATH_INFO: `/v3/users/d822c2d4697b4ba6b5c7cf5c0a83ed50` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.665077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d822c2d4697b4ba6b5c7cf5c0a83ed50)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.669250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.678582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc9098-548e-4296-856e-6ff6821f6627 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.685174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.685867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.686180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.686544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] PATH_INFO: `/v3/projects/0742aeda811f4c558dc363283b25c894/users/0dff6aaebf464af9a1decef8de7e135b/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.688636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0742aeda811f4c558dc363283b25c894, user_id=0dff6aaebf464af9a1decef8de7e135b, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.692487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.708324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 977/1947] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:16 2022] PUT /identity/v3/projects/0742aeda811f4c558dc363283b25c894/users/0dff6aaebf464af9a1decef8de7e135b/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:16.709064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.743611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd822c2d4697b4ba6b5c7cf5c0a83ed50'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.744779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd822c2d4697b4ba6b5c7cf5c0a83ed50'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.746270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd822c2d4697b4ba6b5c7cf5c0a83ed50'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.760426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd822c2d4697b4ba6b5c7cf5c0a83ed50'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.780523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b37b1c6a-5875-4a78-8f2e-f34fe24b4425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd822c2d4697b4ba6b5c7cf5c0a83ed50'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:16.799693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f187-8ea6-4731-a893-7808bef4a6ae admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.806131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.806920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 971/1948] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:16 2022] DELETE /identity/v3/users/d822c2d4697b4ba6b5c7cf5c0a83ed50 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:16.808443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.808443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.808664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.810088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.810626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.811594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.812634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.814706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:16.848997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] MFA Rules not processed for user `0dff6aaebf464af9a1decef8de7e135b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:16.852932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 978/1949] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:16 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:16.853106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.854702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.856574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.890913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:16.949910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:16.961349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 972/1950] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:16.972799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:16.974069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a433f-08a6-4063-bc43-f0d645a2f807 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:16.974761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:16.983616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:16.984310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:16.984563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:16.984772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:16.985563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:16.987364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.021245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 979/1951] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:16 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:17.021414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.049555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26816304-d647-4c7b-b439-ccea6a0f7238 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.067496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.068345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.068733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.069724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.071263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.075392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.088246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94e9b1-a672-41c5-9b8e-1aecb29065db None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.092390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.093110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.093485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.093854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.101575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 980/1952] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:17.102563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.109946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.111416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.113396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05ef9c-b3e3-4ccb-925e-abfa1076aa29 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.119155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.119776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.120202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.120473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.121389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.122760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 973/1953] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:17.144198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.177937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 981/1954] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:17.182993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.208245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1b18-575d-4122-a4cf-1c6ef94fa250 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.228275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.229747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.230698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.234631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] PATH_INFO: `/v3/projects/43fb9af304494bdfa72fbcf9505cf413/users/28bda3eca740452db48fc8045734512d/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.237573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.239685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:17.268005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717631d-19e4-4f1e-b465-e8317f3c7f37 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.283574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.284882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.284882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.285089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] PATH_INFO: `/v3/projects/4130b7f7a6ac4cbabf2fca5a64481f4e` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.286573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4130b7f7a6ac4cbabf2fca5a64481f4e)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.289038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.291295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fb9af304494bdfa72fbcf9505cf413, user_id=28bda3eca740452db48fc8045734512d, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.295085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.329824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 974/1955] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:17 2022] PUT /identity/v3/projects/43fb9af304494bdfa72fbcf9505cf413/users/28bda3eca740452db48fc8045734512d/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:17.343196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.345143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:17.377313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4130b7f7a6ac4cbabf2fca5a64481f4e', 'request_id': 'req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:17.395502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4130b7f7a6ac4cbabf2fca5a64481f4e', 'request_id': 'req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:17.418544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cca80f-6520-4698-b662-1860123ce642 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.421999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4130b7f7a6ac4cbabf2fca5a64481f4e', 'request_id': 'req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:17.447492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] The token cache is being invalidate because project 4130b7f7a6ac4cbabf2fca5a64481f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:17.447795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:17.448473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-78ee6b5d-58fb-4d0d-8098-4002bfcebe16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:17.455586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 982/1956] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:17 2022] DELETE /identity/v3/projects/4130b7f7a6ac4cbabf2fca5a64481f4e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:17.455586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05e94e-45d2-4d89-875a-2f6f42c40936 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.455586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05e94e-45d2-4d89-875a-2f6f42c40936 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.455586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05e94e-45d2-4d89-875a-2f6f42c40936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.492299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2c05e94e-45d2-4d89-875a-2f6f42c40936 None None] MFA Rules not processed for user `28bda3eca740452db48fc8045734512d`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:17.493974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2c05e94e-45d2-4d89-875a-2f6f42c40936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:17.540743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3952d-e2e8-462e-9014-dbece30f0654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.542011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3952d-e2e8-462e-9014-dbece30f0654 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.542326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3952d-e2e8-462e-9014-dbece30f0654 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.542610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3952d-e2e8-462e-9014-dbece30f0654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.549733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5af3952d-e2e8-462e-9014-dbece30f0654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:17.579650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:17.593277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 983/1957] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:17.595301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.595419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.595682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.626458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:17.628767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:17.697597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:17.721338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3952d-e2e8-462e-9014-dbece30f0654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.723370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3952d-e2e8-462e-9014-dbece30f0654 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.754557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 975/1958] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:17.784319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 984/1959] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:17.793785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ef22f-edc3-4b6e-9ebd-b4287cbaa03f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.794126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ef22f-edc3-4b6e-9ebd-b4287cbaa03f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.794365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ef22f-edc3-4b6e-9ebd-b4287cbaa03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.830205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3f3ef22f-edc3-4b6e-9ebd-b4287cbaa03f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:17.833258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3f3ef22f-edc3-4b6e-9ebd-b4287cbaa03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:17.841108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.842625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:17.847750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 976/1960] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:17.852253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ef22f-edc3-4b6e-9ebd-b4287cbaa03f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.863320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ef22f-edc3-4b6e-9ebd-b4287cbaa03f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.867164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf937d-3046-4974-8fd1-4290ee0707b4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.869873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.870663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.870954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.871443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.871981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:17.872310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.873565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.874667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.875032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.875327 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.875843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.895639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 977/1961] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:29:17.896738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.912272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61e699-9b06-40c4-aeb0-27bce494b0e4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:17.919523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:17.920158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:17.920444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:17.920731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:17.921044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.921989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:17.923542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.924975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:17.954206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 985/1962] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:17.979473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 978/1963] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:17 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:17.983658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:17.996066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54bcf0-2c29-49d3-b5e8-441504e56a66 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:18.077072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:18.077901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.078220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.078498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.079181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:18.081322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:18.111472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 986/1964] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:17 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:18.116169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:18.149199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b930b9-6c43-47d3-aee0-99a60c62292b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:18.156933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:18.157797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.158261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.158670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.159720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:18.161789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:18.175896 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 979/1965] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:18.180694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:18.194189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c84b6-25df-4e16-90e7-2a7c69cc9701 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:18.200777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06ec4e-b631-45b8-892e-250d36ec3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:18.201463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ec4e-b631-45b8-892e-250d36ec3ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.201812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ec4e-b631-45b8-892e-250d36ec3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.202137 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06ec4e-b631-45b8-892e-250d36ec3ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.203000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06ec4e-b631-45b8-892e-250d36ec3ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:18.204716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06ec4e-b631-45b8-892e-250d36ec3ef6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:18.220603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 987/1966] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:18.221812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:18.238012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc94d7f-97ad-4f72-9ed1-85a0f6e3d5bd admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:18.244453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:18.244892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.245210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.245462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] PATH_INFO: `/v3/projects/ef6ccc0e3b9147a38ab150f008ff5274/users/26b3a9c2373b4f0c859e62e9966aba3e/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.264848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6ccc0e3b9147a38ab150f008ff5274, user_id=26b3a9c2373b4f0c859e62e9966aba3e, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:18.270259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:18.292251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 980/1967] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:18 2022] PUT /identity/v3/projects/ef6ccc0e3b9147a38ab150f008ff5274/users/26b3a9c2373b4f0c859e62e9966aba3e/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:18.311829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4be520-26a5-4a66-b3bf-e637bb6c0b7f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.312544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4be520-26a5-4a66-b3bf-e637bb6c0b7f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.312850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4be520-26a5-4a66-b3bf-e637bb6c0b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.367683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3b4be520-26a5-4a66-b3bf-e637bb6c0b7f None None] MFA Rules not processed for user `26b3a9c2373b4f0c859e62e9966aba3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:18.369022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3b4be520-26a5-4a66-b3bf-e637bb6c0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:18.454848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:18.481862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 988/1968] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:18.493233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:18.494994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:18.552088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9b283-32d8-4350-9640-32f12faeb4b7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:18.555764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8294824-9793-4339-ac4d-2406308bb4cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:18.556362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8294824-9793-4339-ac4d-2406308bb4cd service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.556652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8294824-9793-4339-ac4d-2406308bb4cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.556911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8294824-9793-4339-ac4d-2406308bb4cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.564942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8294824-9793-4339-ac4d-2406308bb4cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:18.566400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8294824-9793-4339-ac4d-2406308bb4cd service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:18.575466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 981/1969] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:18.595851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4be520-26a5-4a66-b3bf-e637bb6c0b7f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:18.662575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4be520-26a5-4a66-b3bf-e637bb6c0b7f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:18.667134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:18.667787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.668064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.668331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] PATH_INFO: `/v3/users/26b3a9c2373b4f0c859e62e9966aba3e` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.669473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b3a9c2373b4f0c859e62e9966aba3e)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:18.671404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:18.719420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b3a9c2373b4f0c859e62e9966aba3e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:18.726916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b3a9c2373b4f0c859e62e9966aba3e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:18.727699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b3a9c2373b4f0c859e62e9966aba3e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:18.735268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b3a9c2373b4f0c859e62e9966aba3e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:18.735936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b3a9c2373b4f0c859e62e9966aba3e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:18.757279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 989/1970] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:18 2022] DELETE /identity/v3/users/26b3a9c2373b4f0c859e62e9966aba3e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:18.762450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.762802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.763177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.785583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:18.787777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:18.859789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 982/1971] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:18.870739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:18.872173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:18.933953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa3253-5262-451d-a024-785473b037c1 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:18.937842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91f76a-d018-4354-afab-4d91efbc53a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:18.938921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f76a-d018-4354-afab-4d91efbc53a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:18.938921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f76a-d018-4354-afab-4d91efbc53a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:18.939087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91f76a-d018-4354-afab-4d91efbc53a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:18.949075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91f76a-d018-4354-afab-4d91efbc53a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:18.950562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91f76a-d018-4354-afab-4d91efbc53a1 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:18.961217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 990/1972] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:19.284217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:19.286271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:19.313395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f100-2e55-49da-b8d1-006228a3e063 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:19.336921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:19.338573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.339276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.339849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] PATH_INFO: `/v3/projects/ef6ccc0e3b9147a38ab150f008ff5274` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.343706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6ccc0e3b9147a38ab150f008ff5274)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:19.346010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:19.360002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:19.446880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6ccc0e3b9147a38ab150f008ff5274', 'request_id': 'req-3d2b95ac-08d9-4377-b25e-8824ec33c522'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:19.467379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6ccc0e3b9147a38ab150f008ff5274', 'request_id': 'req-3d2b95ac-08d9-4377-b25e-8824ec33c522'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:19.477531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6ccc0e3b9147a38ab150f008ff5274', 'request_id': 'req-3d2b95ac-08d9-4377-b25e-8824ec33c522'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:19.492922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] The token cache is being invalidate because project ef6ccc0e3b9147a38ab150f008ff5274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:19.493278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:19.494333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3d2b95ac-08d9-4377-b25e-8824ec33c522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:19.499820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 983/1973] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:19 2022] DELETE /identity/v3/projects/ef6ccc0e3b9147a38ab150f008ff5274 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:19.502489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb07b-dbbd-4fbc-b3c3-0e7a7954a25d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.502921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb07b-dbbd-4fbc-b3c3-0e7a7954a25d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.503064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb07b-dbbd-4fbc-b3c3-0e7a7954a25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.526563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-40bbb07b-dbbd-4fbc-b3c3-0e7a7954a25d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:19.527822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-40bbb07b-dbbd-4fbc-b3c3-0e7a7954a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:19.538635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:19.609270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 991/1974] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:19.617730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909f35-fa43-4780-826f-b478b407cb86 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.618243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909f35-fa43-4780-826f-b478b407cb86 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.618594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909f35-fa43-4780-826f-b478b407cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.644981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-56909f35-fa43-4780-826f-b478b407cb86 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:19.646534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-56909f35-fa43-4780-826f-b478b407cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:19.660102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 984/1975] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:19.660855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbb07b-dbbd-4fbc-b3c3-0e7a7954a25d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:19.674391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbb07b-dbbd-4fbc-b3c3-0e7a7954a25d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:19.682564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:19.691043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.691336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.691622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.693473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:19.694450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:19.696115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:19.726409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 992/1976] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:29:19.731288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56909f35-fa43-4780-826f-b478b407cb86 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:19.745662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56909f35-fa43-4780-826f-b478b407cb86 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:19.751581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:19.752528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.753217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.753695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.755147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:19.758306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:19.801875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 985/1977] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:19 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:19.807019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:19.829739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7255f3c-7ee2-4aeb-b220-9c0da10ea490 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:19.909097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:19.909633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.910109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.910426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.911055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:19.913836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:19.936436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 993/1978] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:19 2022] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:19.940334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:19.952724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8616dd-8236-4f12-b6a9-0a0dba82ab22 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:19.959011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:19.960202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.960482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.960930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.961584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:19.963231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:19.977949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 986/1979] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:19.979078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:19.991338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da080376-33f6-43b1-90aa-582f97a1277b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:19.997227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bcca7-cffc-42ff-a32d-a5aa35c50430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:19.998102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bcca7-cffc-42ff-a32d-a5aa35c50430 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:19.998102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bcca7-cffc-42ff-a32d-a5aa35c50430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:19.998343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bcca7-cffc-42ff-a32d-a5aa35c50430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:19.998990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bcca7-cffc-42ff-a32d-a5aa35c50430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:20.000865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bcca7-cffc-42ff-a32d-a5aa35c50430 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:20.016307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 994/1980] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:20.021173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:20.040715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150c052-d8ba-4e6d-87d2-b9fbabd151bb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:20.046988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:20.047985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.048448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.048928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] PATH_INFO: `/v3/projects/f69e579362c0465f88260af6f25c8873/users/860015df99e940719d576a80ded5e3ba/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.099426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69e579362c0465f88260af6f25c8873, user_id=860015df99e940719d576a80ded5e3ba, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:20.102680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:20.144325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54ebb9-bcb3-4abe-9aaf-0363289d5320 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.144637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54ebb9-bcb3-4abe-9aaf-0363289d5320 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.144872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54ebb9-bcb3-4abe-9aaf-0363289d5320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.147068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 987/1981] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:20 2022] PUT /identity/v3/projects/f69e579362c0465f88260af6f25c8873/users/860015df99e940719d576a80ded5e3ba/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:20.195178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ba54ebb9-bcb3-4abe-9aaf-0363289d5320 None None] MFA Rules not processed for user `860015df99e940719d576a80ded5e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:20.196695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ba54ebb9-bcb3-4abe-9aaf-0363289d5320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:20.292231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 995/1982] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:20.305277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:20.306996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:20.377986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca145db-3583-4eae-81b7-836a4aebedf8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:20.382077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210910c9-834a-466e-bcd8-d3810580f22a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:20.382796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210910c9-834a-466e-bcd8-d3810580f22a service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.384158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210910c9-834a-466e-bcd8-d3810580f22a service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.384454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210910c9-834a-466e-bcd8-d3810580f22a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.396383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210910c9-834a-466e-bcd8-d3810580f22a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:20.398027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210910c9-834a-466e-bcd8-d3810580f22a service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:20.408295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 988/1983] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:20.433148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54ebb9-bcb3-4abe-9aaf-0363289d5320 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:20.447435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:20.531087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54ebb9-bcb3-4abe-9aaf-0363289d5320 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:20.536023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:20.536664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.537059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.537201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] PATH_INFO: `/v3/users/860015df99e940719d576a80ded5e3ba` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.539080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] RBAC: Authorizing `identity:delete_user(user_id=860015df99e940719d576a80ded5e3ba)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:20.541198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:20.607341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860015df99e940719d576a80ded5e3ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.619988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860015df99e940719d576a80ded5e3ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.623035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860015df99e940719d576a80ded5e3ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.639603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860015df99e940719d576a80ded5e3ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.640498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860015df99e940719d576a80ded5e3ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.665782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 996/1984] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:20 2022] DELETE /identity/v3/users/860015df99e940719d576a80ded5e3ba => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:20.670296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.671103 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.671377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.690965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:20.692164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:20.729293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:20.771677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 989/1985] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:20.785025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:20.786492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:20.802619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:20.804152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:20.816823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a306c-60e7-48aa-92c7-91be02c0f0ba None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:20.823981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:20.824672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.824955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.825228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] PATH_INFO: `/v3/users/28bda3eca740452db48fc8045734512d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.826608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=28bda3eca740452db48fc8045734512d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:20.829606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:20.867331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bf695-5bdf-4f6b-a826-4ac9b81a002c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:20.870200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3936b2-6a5f-4782-9b40-fa3776aff94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:20.870926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3936b2-6a5f-4782-9b40-fa3776aff94e service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.871227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3936b2-6a5f-4782-9b40-fa3776aff94e service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.871544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3936b2-6a5f-4782-9b40-fa3776aff94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.887650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3936b2-6a5f-4782-9b40-fa3776aff94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:20.889096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3936b2-6a5f-4782-9b40-fa3776aff94e service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:20.893862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28bda3eca740452db48fc8045734512d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.894643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28bda3eca740452db48fc8045734512d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.895333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28bda3eca740452db48fc8045734512d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.899572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 997/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:20.904951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28bda3eca740452db48fc8045734512d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.915213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28bda3eca740452db48fc8045734512d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:20.950879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 990/1987] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:20 2022] DELETE /identity/v3/users/28bda3eca740452db48fc8045734512d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:20.958540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:20.959742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:20.959742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:20.982282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:20.983521 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:21.019745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:21.102117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 998/1988] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:21.117117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:21.120493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:21.222814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63eb7c-db5c-441c-99da-ad34bfb856bc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:21.227793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6828-84ed-45e0-aff1-f3c01c873985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:21.228517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6828-84ed-45e0-aff1-f3c01c873985 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:21.228793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6828-84ed-45e0-aff1-f3c01c873985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:21.229141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6828-84ed-45e0-aff1-f3c01c873985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:21.246639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6828-84ed-45e0-aff1-f3c01c873985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:21.248204 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6828-84ed-45e0-aff1-f3c01c873985 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:21.259955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 991/1989] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:21.325401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:21.327707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:21.349743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83833b-a454-4d5d-be2d-56f4382d1c4a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:21.359357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:21.360220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:21.360705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:21.361255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] PATH_INFO: `/v3/projects/f69e579362c0465f88260af6f25c8873` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:21.362937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69e579362c0465f88260af6f25c8873)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:21.365762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:21.460937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69e579362c0465f88260af6f25c8873', 'request_id': 'req-be9dfaaf-a49e-422d-a302-db2fab8b702c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:21.487460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69e579362c0465f88260af6f25c8873', 'request_id': 'req-be9dfaaf-a49e-422d-a302-db2fab8b702c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:21.509311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69e579362c0465f88260af6f25c8873', 'request_id': 'req-be9dfaaf-a49e-422d-a302-db2fab8b702c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:21.535971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] The token cache is being invalidate because project f69e579362c0465f88260af6f25c8873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:21.536605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:21.538214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:21.542177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 999/1990] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:21 2022] DELETE /identity/v3/projects/f69e579362c0465f88260af6f25c8873 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:21.549273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e95d-9121-402c-8227-018d09054bc0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:21.549776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e95d-9121-402c-8227-018d09054bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:21.550250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338e95d-9121-402c-8227-018d09054bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:21.599934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a338e95d-9121-402c-8227-018d09054bc0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:21.601198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a338e95d-9121-402c-8227-018d09054bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:21.764930 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:21.783489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:21.789944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:21.803985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 992/1991] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:21.819480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb188f1-c875-4158-846f-c5aa9194eb87 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:21.820230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb188f1-c875-4158-846f-c5aa9194eb87 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:21.820706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb188f1-c875-4158-846f-c5aa9194eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:21.822134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dfaaf-a49e-422d-a302-db2fab8b702c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:21.831190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:21.831857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:21.832198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:21.832738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] PATH_INFO: `/v3/projects/43fb9af304494bdfa72fbcf9505cf413` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:21.840627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fb9af304494bdfa72fbcf9505cf413)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:21.843770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:21.872029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cdb188f1-c875-4158-846f-c5aa9194eb87 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:21.873284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cdb188f1-c875-4158-846f-c5aa9194eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:21.886968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 993/1992] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:21.899515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb188f1-c875-4158-846f-c5aa9194eb87 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:21.921161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb188f1-c875-4158-846f-c5aa9194eb87 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:21.944531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fb9af304494bdfa72fbcf9505cf413', 'request_id': 'req-37f4736b-5c27-4793-b84b-b2bc65b43569'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:21.961453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fb9af304494bdfa72fbcf9505cf413', 'request_id': 'req-37f4736b-5c27-4793-b84b-b2bc65b43569'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:21.981341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fb9af304494bdfa72fbcf9505cf413', 'request_id': 'req-37f4736b-5c27-4793-b84b-b2bc65b43569'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.002093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] The token cache is being invalidate because project 43fb9af304494bdfa72fbcf9505cf413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:22.002093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.003255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-37f4736b-5c27-4793-b84b-b2bc65b43569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.005863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1000/1993] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:21 2022] DELETE /identity/v3/projects/43fb9af304494bdfa72fbcf9505cf413 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:22.021683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814f44-2c24-4bb1-b242-76751e505cdc None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.022175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814f44-2c24-4bb1-b242-76751e505cdc None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.022464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65814f44-2c24-4bb1-b242-76751e505cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.049005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-65814f44-2c24-4bb1-b242-76751e505cdc None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:22.050264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-65814f44-2c24-4bb1-b242-76751e505cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.111392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.111392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.111392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.111392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.111968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:22.112041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.113860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.127296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:22.149720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 994/1994] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:22.150886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.152899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.169180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea431a28-7df3-4b8b-927f-c0daf1fddbb9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.177690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.179031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.179317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.179584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.180220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.183266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.192113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1001/1995] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:22.200757 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712cd-2b62-4462-b7ab-f65c22e187ca None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.201316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712cd-2b62-4462-b7ab-f65c22e187ca None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.201701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87712cd-2b62-4462-b7ab-f65c22e187ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.236332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 995/1996] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:22.237640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.261926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b87712cd-2b62-4462-b7ab-f65c22e187ca None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:22.264767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b87712cd-2b62-4462-b7ab-f65c22e187ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.321767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a08975-20e5-42f8-a14e-82722ce0abf8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.327984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.329037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.329431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.329845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.331180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.333691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.342742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1002/1997] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:22.348223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87712cd-2b62-4462-b7ab-f65c22e187ca None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.361573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87712cd-2b62-4462-b7ab-f65c22e187ca None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.374495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 996/1998] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:22.379863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.383377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.386903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.386903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.387115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.388039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:22.388361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.396061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1e56-204d-4e77-9faa-aee636eef60b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.400069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.403029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.404124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.404124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.404456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.405216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.406955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.419050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 997/2000] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:22.419305 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1003/2000] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:29:22.423022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.427091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.437758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3685f-d598-4cd9-b6a1-6bd8523bd386 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.442671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558a9c4-581f-4f62-a6e1-d9a3661d0923 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.444397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.445136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.445413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.445808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.446540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.448297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.462443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1004/2001] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:22.478106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.478667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.479340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.479852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.480321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.481135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.483475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.497290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfd439-b82f-47ab-8f21-0c8d0021a539 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.503072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a9308-ab43-4e69-8703-bd6e2438c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.503841 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a9308-ab43-4e69-8703-bd6e2438c9a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.504181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a9308-ab43-4e69-8703-bd6e2438c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.504676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a9308-ab43-4e69-8703-bd6e2438c9a7 admin admin] PATH_INFO: `/v3/projects/06422e3288ca43378b92086d37a41dca/users/5bee44d942424d2eac192759d4aff4d2/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.522988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 998/2002] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:22.524175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.528350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a9308-ab43-4e69-8703-bd6e2438c9a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06422e3288ca43378b92086d37a41dca, user_id=5bee44d942424d2eac192759d4aff4d2, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.531089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a9308-ab43-4e69-8703-bd6e2438c9a7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.544334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:22.551750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1005/2003] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:22 2022] PUT /identity/v3/projects/06422e3288ca43378b92086d37a41dca/users/5bee44d942424d2eac192759d4aff4d2/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:22.571944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.572298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.573357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.642982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d31b-daff-4d0e-9196-b5f95934513a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.658191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] MFA Rules not processed for user `5bee44d942424d2eac192759d4aff4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:22.659117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.713899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.714589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.714883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.715982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.716436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.718554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.738230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1006/2004] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:22.739111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.740107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 999/2005] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:22.740408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.743858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.754376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258322f-0e20-4097-b1e7-8073144d322e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.754899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4844733-78f4-4de0-b209-90f23b227e9d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.759861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.760666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.760849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.760960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.761165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.761550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.761775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.761883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.762113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] PATH_INFO: `/v3/users/e130bb7af152475fa8e986c33be6f177` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.763290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e130bb7af152475fa8e986c33be6f177)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.763410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.765359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.775300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1000/2006] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:22.776254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.777952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.783938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:22.824167 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e130bb7af152475fa8e986c33be6f177'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.831922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e130bb7af152475fa8e986c33be6f177'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.832808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e130bb7af152475fa8e986c33be6f177'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.839411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce834c2-d7a6-46c1-9ff3-0b20de5ee1c8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.841091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e130bb7af152475fa8e986c33be6f177'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.841746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e130bb7af152475fa8e986c33be6f177'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:22.843183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5244c6-b6ee-4bee-ad6e-e621745db0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.843788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5244c6-b6ee-4bee-ad6e-e621745db0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.844064 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5244c6-b6ee-4bee-ad6e-e621745db0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.844327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5244c6-b6ee-4bee-ad6e-e621745db0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.846083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ef5244c6-b6ee-4bee-ad6e-e621745db0d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.857336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5244c6-b6ee-4bee-ad6e-e621745db0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.858917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5244c6-b6ee-4bee-ad6e-e621745db0d2 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.862341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1007/2007] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:22 2022] DELETE /identity/v3/users/e130bb7af152475fa8e986c33be6f177 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:22.863199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.865493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.868463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1001/2008] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:22.871415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.871809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.872174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.894082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:22.895294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.934935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:22.943237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053756-60c9-4332-a3eb-08d107c1c4c8 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.948484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.949084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.949362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.949638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.950339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.952007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:22.958130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1002/2009] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:22.959229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.961076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.969689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1008/2010] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:22.969689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:22.970985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:22.973455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b1052-341f-43f6-a4ba-afdf98a32b78 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:22.978712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:22.979372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:22.979650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:22.979921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] PATH_INFO: `/v3/users/5bee44d942424d2eac192759d4aff4d2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:22.981117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bee44d942424d2eac192759d4aff4d2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:22.983092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:23.035672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2226b53-22e0-408c-943f-0b67dbf6ecd2 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:23.039987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bee44d942424d2eac192759d4aff4d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.040119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:23.040668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:23.040893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bee44d942424d2eac192759d4aff4d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.040989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:23.041206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:23.041690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bee44d942424d2eac192759d4aff4d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.043627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.049968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bee44d942424d2eac192759d4aff4d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.061058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:23.063041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:23.067180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2798a918-3c91-4bcc-8632-df523535864f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bee44d942424d2eac192759d4aff4d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.074906 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1009/2011] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:23.075642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:23.076918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.089108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c72b7-3fac-4589-a128-b4a6516838c7 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:23.089613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1003/2012] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:22 2022] DELETE /identity/v3/users/5bee44d942424d2eac192759d4aff4d2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:23.094947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:23.094947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:23.094947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:23.122311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:23.126280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:23.128574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.164719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8bc57-d9a8-4023-acf4-7fbb7ab70af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:23.165492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8bc57-d9a8-4023-acf4-7fbb7ab70af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:23.165837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8bc57-d9a8-4023-acf4-7fbb7ab70af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:23.166211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8bc57-d9a8-4023-acf4-7fbb7ab70af5 admin admin] PATH_INFO: `/v3/projects/9caa57103f19405b8d9aa4bbdeb1cdae/users/3311feea4091425d8f1545d2071a4a9c/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:23.186949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8bc57-d9a8-4023-acf4-7fbb7ab70af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9caa57103f19405b8d9aa4bbdeb1cdae, user_id=3311feea4091425d8f1545d2071a4a9c, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:23.190523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8bc57-d9a8-4023-acf4-7fbb7ab70af5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:23.222105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1010/2013] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:23 2022] PUT /identity/v3/projects/9caa57103f19405b8d9aa4bbdeb1cdae/users/3311feea4091425d8f1545d2071a4a9c/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:23.222501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1004/2014] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:23.224897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:23.225238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:23.225577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:23.231036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:23.234814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.264749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] MFA Rules not processed for user `3311feea4091425d8f1545d2071a4a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:23.266216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.327483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c597f-9b27-489e-bea9-af50964ea997 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:23.340755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:23.360698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1011/2015] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:23.378735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:23.378735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.427985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:23.428893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:23.429295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:23.429571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:23.471149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7d0c4-2a71-4c61-8415-e9bac9b39c24 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:23.477924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:23.478489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:23.478772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:23.479132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:23.488037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:23.489503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:23.500411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1012/2016] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:23.514843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:23.518681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:23.529715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1005/2017] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:23.733383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:23.736773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.777138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67d918-c48f-45ec-9995-07bf22f2bcce service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:23.789398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:23.790491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:23.792117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:23.792575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] PATH_INFO: `/v3/projects/fa993656c8634583b9350f92ff3e31b5` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:23.796248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa993656c8634583b9350f92ff3e31b5)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:23.799815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:23.882534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:23.885562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:23.910841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbabc5-9bd9-47c3-a8f7-8b5984bdf21b service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:23.917050 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:23.938401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa993656c8634583b9350f92ff3e31b5', 'request_id': 'req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.961571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa993656c8634583b9350f92ff3e31b5', 'request_id': 'req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.978076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa993656c8634583b9350f92ff3e31b5', 'request_id': 'req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:23.999476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] The token cache is being invalidate because project fa993656c8634583b9350f92ff3e31b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:24.000225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.000537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:24.002684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.003463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.003463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] PATH_INFO: `/v3/users/4bad3b4f09f34ef08f6df9c2fbdde576` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.005121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bad3b4f09f34ef08f6df9c2fbdde576)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:24.006026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.009368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:24.014496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1013/2018] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:23 2022] DELETE /identity/v3/projects/fa993656c8634583b9350f92ff3e31b5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:24.016253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:24.020292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:24.061895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b69cd-0dc4-433b-bf15-f5b7806c6ca7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:24.076472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:24.077717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.078186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.078608 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] PATH_INFO: `/v3/users/db5d6c12339f4a00abb62fba8f278ae1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.082082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5d6c12339f4a00abb62fba8f278ae1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:24.085412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:24.128079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bad3b4f09f34ef08f6df9c2fbdde576'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.128839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bad3b4f09f34ef08f6df9c2fbdde576'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.129520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bad3b4f09f34ef08f6df9c2fbdde576'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.144082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bad3b4f09f34ef08f6df9c2fbdde576'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.156730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ba5385ff-2f3e-4dc7-829f-7d059fc7e073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bad3b4f09f34ef08f6df9c2fbdde576'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.157101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5d6c12339f4a00abb62fba8f278ae1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.158907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:24.177905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5d6c12339f4a00abb62fba8f278ae1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.178772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5d6c12339f4a00abb62fba8f278ae1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.190486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5d6c12339f4a00abb62fba8f278ae1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.191514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5d6c12339f4a00abb62fba8f278ae1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.204492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1006/2019] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:23 2022] DELETE /identity/v3/users/4bad3b4f09f34ef08f6df9c2fbdde576 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:24.212914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64790-250d-4df8-b582-ae340698e723 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.213742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64790-250d-4df8-b582-ae340698e723 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.215239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c64790-250d-4df8-b582-ae340698e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.233840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1014/2020] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:24 2022] DELETE /identity/v3/users/db5d6c12339f4a00abb62fba8f278ae1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:24.248260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-78c64790-250d-4df8-b582-ae340698e723 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:24.249381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-78c64790-250d-4df8-b582-ae340698e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:24.327852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1007/2021] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:24.351033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:24.352664 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:24.436638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0913d4-5543-4362-b063-5425a6bdfa87 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:24.440347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc350fbc-d0dc-432e-be78-4cd3cf39fd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:24.440965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350fbc-d0dc-432e-be78-4cd3cf39fd9f service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.441248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350fbc-d0dc-432e-be78-4cd3cf39fd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.441539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc350fbc-d0dc-432e-be78-4cd3cf39fd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.453064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350fbc-d0dc-432e-be78-4cd3cf39fd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:24.455057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc350fbc-d0dc-432e-be78-4cd3cf39fd9f service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:24.472130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1015/2022] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:24.644145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c64790-250d-4df8-b582-ae340698e723 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:24.645780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-78c64790-250d-4df8-b582-ae340698e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:24.660674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c64790-250d-4df8-b582-ae340698e723 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:24.668082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:24.668911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.669289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.669665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] PATH_INFO: `/v3/projects/06422e3288ca43378b92086d37a41dca` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.670947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06422e3288ca43378b92086d37a41dca)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:24.672879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:24.745468 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06422e3288ca43378b92086d37a41dca', 'request_id': 'req-f1979ade-c572-4f69-b48f-32f982cfc10a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.754721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06422e3288ca43378b92086d37a41dca', 'request_id': 'req-f1979ade-c572-4f69-b48f-32f982cfc10a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.763905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06422e3288ca43378b92086d37a41dca', 'request_id': 'req-f1979ade-c572-4f69-b48f-32f982cfc10a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.778896 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] The token cache is being invalidate because project 06422e3288ca43378b92086d37a41dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:24.779445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.780178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1979ade-c572-4f69-b48f-32f982cfc10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:24.787101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932cdc-ebf7-48a5-ab42-e0abe13cb646 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.787660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932cdc-ebf7-48a5-ab42-e0abe13cb646 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.788126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932cdc-ebf7-48a5-ab42-e0abe13cb646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.790901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1008/2023] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:24 2022] DELETE /identity/v3/projects/06422e3288ca43378b92086d37a41dca => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:24.810721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d4932cdc-ebf7-48a5-ab42-e0abe13cb646 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:24.812104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d4932cdc-ebf7-48a5-ab42-e0abe13cb646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:24.860854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:24.903141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1016/2024] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:24.911272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f6c1-bd05-4576-ad6a-b25d43bab4f2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.911799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f6c1-bd05-4576-ad6a-b25d43bab4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.911876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9f6c1-bd05-4576-ad6a-b25d43bab4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.938284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3ab9f6c1-bd05-4576-ad6a-b25d43bab4f2 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:24.939459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3ab9f6c1-bd05-4576-ad6a-b25d43bab4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:24.952384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1009/2025] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:24.955014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4932cdc-ebf7-48a5-ab42-e0abe13cb646 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:24.967447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4932cdc-ebf7-48a5-ab42-e0abe13cb646 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:24.973483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:24.974396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:24.975568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:24.975735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:24.976312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:24.976647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:24.978342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:24.991491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1017/2026] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:24.996091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f6c1-bd05-4576-ad6a-b25d43bab4f2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:25.007452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9f6c1-bd05-4576-ad6a-b25d43bab4f2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:25.012578 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:25.013316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:25.013700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:25.014141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:25.015099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:25.017176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:25.051606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1010/2027] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:24 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:25.072126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:25.087159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72127-85fa-4729-a45e-578c916b3543 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:25.168343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:25.168977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:25.169373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:25.170334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:25.171123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:25.173298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:25.200549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1018/2028] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:25 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:25.204332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:25.217323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136570a4-1c7f-4f19-bce0-12cfa885f818 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:25.224469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:25.225674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:25.225965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:25.226276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:25.227001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:25.229758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:25.250151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1011/2029] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:25.253340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:25.269650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35848fd0-e605-496f-b918-68a341aee15a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:25.277150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcee224-57c2-4876-a8df-4121bad256c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:25.277925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee224-57c2-4876-a8df-4121bad256c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:25.278329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee224-57c2-4876-a8df-4121bad256c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:25.278591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcee224-57c2-4876-a8df-4121bad256c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:25.279526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcee224-57c2-4876-a8df-4121bad256c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:25.281522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcee224-57c2-4876-a8df-4121bad256c1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:25.298086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1019/2030] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:25.299664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:25.312219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8ca7-b2c4-4cfc-af44-de2655914709 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:25.324949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:25.325648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:25.325916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:25.326244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] PATH_INFO: `/v3/projects/8c3cca9902a7435e9a08147972c75c1f/users/4d2f36ce3d8643f39771e1f1bc6df096/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:25.348724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3cca9902a7435e9a08147972c75c1f, user_id=4d2f36ce3d8643f39771e1f1bc6df096, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:25.353120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:25.371504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:25.382037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1012/2031] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:25 2022] PUT /identity/v3/projects/8c3cca9902a7435e9a08147972c75c1f/users/4d2f36ce3d8643f39771e1f1bc6df096/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:25.397657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:25.398124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:25.398537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:25.437792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] MFA Rules not processed for user `4d2f36ce3d8643f39771e1f1bc6df096`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:25.439659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:25.540863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1020/2032] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:25.562910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:25.565733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:25.653937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c643221-9559-4dd1-bc22-1cd3adda1ac3 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:25.658198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:25.658932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:25.659190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:25.659475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:25.673157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:25.674638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:25.685630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1013/2033] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:25.888166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:25.889720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:26.043502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:26.100221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092967d-69b0-4568-a0b1-fb09c5827ec4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:26.112226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:26.112936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:26.113227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:26.113503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] PATH_INFO: `/v3/projects/9a6545956163482b9fdfd1a86f71e3bd` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:26.116482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6545956163482b9fdfd1a86f71e3bd)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:26.121817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:26.204722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6545956163482b9fdfd1a86f71e3bd', 'request_id': 'req-a2025867-831e-4e21-a889-ab55934ad549'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.216448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:26.217883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:26.231210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6545956163482b9fdfd1a86f71e3bd', 'request_id': 'req-a2025867-831e-4e21-a889-ab55934ad549'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.245407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6545956163482b9fdfd1a86f71e3bd', 'request_id': 'req-a2025867-831e-4e21-a889-ab55934ad549'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.248086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0c15-c5de-4bb5-a1a8-79b211bfc036 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:26.276707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] The token cache is being invalidate because project 9a6545956163482b9fdfd1a86f71e3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:26.277011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.278778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.282582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1021/2034] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:25 2022] DELETE /identity/v3/projects/9a6545956163482b9fdfd1a86f71e3bd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:26.287736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:26.290135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:26.395091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:26.397058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:26.399393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:26.399690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] PATH_INFO: `/v3/projects/906577b2c3e24300bf4c8b2c5fb8009b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:26.402644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906577b2c3e24300bf4c8b2c5fb8009b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:26.408497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:26.437807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2025867-831e-4e21-a889-ab55934ad549 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:26.451629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:26.453001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:26.453001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:26.453265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] PATH_INFO: `/v3/users/0dff6aaebf464af9a1decef8de7e135b` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:26.457868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dff6aaebf464af9a1decef8de7e135b)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:26.460580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:26.546986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906577b2c3e24300bf4c8b2c5fb8009b', 'request_id': 'req-070cd125-da43-456b-bea6-bdf80fa0d348'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.565605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906577b2c3e24300bf4c8b2c5fb8009b', 'request_id': 'req-070cd125-da43-456b-bea6-bdf80fa0d348'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.579908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906577b2c3e24300bf4c8b2c5fb8009b', 'request_id': 'req-070cd125-da43-456b-bea6-bdf80fa0d348'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.606516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dff6aaebf464af9a1decef8de7e135b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.608952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] The token cache is being invalidate because project 906577b2c3e24300bf4c8b2c5fb8009b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:26.609510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.612831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-070cd125-da43-456b-bea6-bdf80fa0d348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.617232 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dff6aaebf464af9a1decef8de7e135b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.618034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dff6aaebf464af9a1decef8de7e135b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.622453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1014/2035] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:26 2022] DELETE /identity/v3/projects/906577b2c3e24300bf4c8b2c5fb8009b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:26.627563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0421b7-0c2a-48f8-931b-739b1271564f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:26.631729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0421b7-0c2a-48f8-931b-739b1271564f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:26.631729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0421b7-0c2a-48f8-931b-739b1271564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:26.635105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dff6aaebf464af9a1decef8de7e135b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.635883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-41c24e89-f63c-4991-9e3c-7414eaf8d8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dff6aaebf464af9a1decef8de7e135b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:26.645604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:26.670420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1022/2036] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:26 2022] DELETE /identity/v3/users/0dff6aaebf464af9a1decef8de7e135b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:26.688607 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0f0421b7-0c2a-48f8-931b-739b1271564f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:26.690037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0f0421b7-0c2a-48f8-931b-739b1271564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:26.763008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:26.860013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1015/2037] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:26.868825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5046ad-6429-4397-b0dd-0a0bb37febb9 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:26.869117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5046ad-6429-4397-b0dd-0a0bb37febb9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:26.869531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5046ad-6429-4397-b0dd-0a0bb37febb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:26.911353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ea5046ad-6429-4397-b0dd-0a0bb37febb9 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:26.912913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ea5046ad-6429-4397-b0dd-0a0bb37febb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:26.969942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1023/2038] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:26.974231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0421b7-0c2a-48f8-931b-739b1271564f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:26.987402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0421b7-0c2a-48f8-931b-739b1271564f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:26.994096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:26.994867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:26.995418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:26.996333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:26.997103 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:26.997521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:27.003497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:27.028725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1016/2039] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:27.030319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5046ad-6429-4397-b0dd-0a0bb37febb9 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:27.044361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5046ad-6429-4397-b0dd-0a0bb37febb9 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:27.069495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9946f-c7fe-475f-b436-3f009e9b9e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:27.070242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9946f-c7fe-475f-b436-3f009e9b9e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.070526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9946f-c7fe-475f-b436-3f009e9b9e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.070844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9946f-c7fe-475f-b436-3f009e9b9e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.071562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9946f-c7fe-475f-b436-3f009e9b9e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:27.073652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9946f-c7fe-475f-b436-3f009e9b9e9e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:27.152737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1024/2040] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:27 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:27.157268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:27.180728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d9b62-f644-4f76-b121-a65a38347185 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:27.278943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f323a-40dd-470a-9d29-79c34d0d194b None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.279630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f323a-40dd-470a-9d29-79c34d0d194b None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.280184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f323a-40dd-470a-9d29-79c34d0d194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.322690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-027f323a-40dd-470a-9d29-79c34d0d194b None None] MFA Rules not processed for user `4d2f36ce3d8643f39771e1f1bc6df096`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:27.323961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-027f323a-40dd-470a-9d29-79c34d0d194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:27.355628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:27.356312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.356483 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.357239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.357888 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:27.359862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:27.403727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1017/2041] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:27 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:27.404613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:27.413952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:27.436569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d62fa-9cbd-4a74-a170-599c03246597 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:27.455715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:27.456177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1025/2042] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:27.458154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.460342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f323a-40dd-470a-9d29-79c34d0d194b None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:27.460774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.461619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] PATH_INFO: `/v3/projects/0742aeda811f4c558dc363283b25c894` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.464087 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0742aeda811f4c558dc363283b25c894)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:27.468406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:27.486835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f323a-40dd-470a-9d29-79c34d0d194b None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:27.496102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:27.499330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.499739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.500115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.503301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:27.505106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:27.528058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1026/2043] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:27.532571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:27.593390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60998d8-3bab-4dea-944b-ea9bcd28e474 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:27.614519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0742aeda811f4c558dc363283b25c894', 'request_id': 'req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:27.634018 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0742aeda811f4c558dc363283b25c894', 'request_id': 'req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:27.653329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0742aeda811f4c558dc363283b25c894', 'request_id': 'req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:27.686668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] The token cache is being invalidate because project 0742aeda811f4c558dc363283b25c894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:27.688142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:27.690979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7152dcd-dfbb-4f8f-9800-81c76b56fceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:27.692700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1018/2044] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:27 2022] DELETE /identity/v3/projects/0742aeda811f4c558dc363283b25c894 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:27.698129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.699451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.700024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.767183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b2174-b58f-40a8-81e2-8b630ed69395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:27.767989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b2174-b58f-40a8-81e2-8b630ed69395 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.768404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b2174-b58f-40a8-81e2-8b630ed69395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.769062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b2174-b58f-40a8-81e2-8b630ed69395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.770659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b2174-b58f-40a8-81e2-8b630ed69395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:27.772482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:27.773717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:27.774461 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b2174-b58f-40a8-81e2-8b630ed69395 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:27.798627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1027/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:27.799507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1019/2046] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:27.807825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:27.809026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef9d6-50e1-4cf6-94f5-02e044ec18cd None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.809424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef9d6-50e1-4cf6-94f5-02e044ec18cd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.809539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:27.809883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef9d6-50e1-4cf6-94f5-02e044ec18cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.827158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875658c3-065a-4434-9736-dccd6736b5fc None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:27.843794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1c8a8-bff1-46e8-bbf1-9e9eb1055a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:27.844490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1c8a8-bff1-46e8-bbf1-9e9eb1055a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.844765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1c8a8-bff1-46e8-bbf1-9e9eb1055a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.845035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1c8a8-bff1-46e8-bbf1-9e9eb1055a5a admin admin] PATH_INFO: `/v3/projects/b40f5ab0e371440e9bef58a7e4b26854/users/0759b54edec14d6ea201a9a4e9b561ba/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.881696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-dd7ef9d6-50e1-4cf6-94f5-02e044ec18cd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:27.887360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dd7ef9d6-50e1-4cf6-94f5-02e044ec18cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:27.894920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1c8a8-bff1-46e8-bbf1-9e9eb1055a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40f5ab0e371440e9bef58a7e4b26854, user_id=0759b54edec14d6ea201a9a4e9b561ba, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:27.902169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1c8a8-bff1-46e8-bbf1-9e9eb1055a5a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:27.927207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1028/2047] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:27.929401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef9d6-50e1-4cf6-94f5-02e044ec18cd None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:27.931742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1020/2048] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:27 2022] PUT /identity/v3/projects/b40f5ab0e371440e9bef58a7e4b26854/users/0759b54edec14d6ea201a9a4e9b561ba/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:27.943688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18700-d786-42f5-89ef-376ab6117a2a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:27.943975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18700-d786-42f5-89ef-376ab6117a2a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:27.944246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18700-d786-42f5-89ef-376ab6117a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:27.969414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:27.978193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef9d6-50e1-4cf6-94f5-02e044ec18cd None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.023877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-80d18700-d786-42f5-89ef-376ab6117a2a None None] MFA Rules not processed for user `0759b54edec14d6ea201a9a4e9b561ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:28.025385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-80d18700-d786-42f5-89ef-376ab6117a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:28.178223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:28.224128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1021/2049] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:28.230639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18700-d786-42f5-89ef-376ab6117a2a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:28.279777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.291741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.292058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.295992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.296751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:28.297069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.310654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.350278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1029/2050] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:28.361016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:28.407659 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18700-d786-42f5-89ef-376ab6117a2a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.408933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b280ccc-ff25-49bd-804b-4728c8f2d377 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.417082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.417820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.418205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.418608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.419993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.422736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.442441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.445398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.445692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.448138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.448784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.457663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.472243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1022/2051] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:28 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:28.476764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:28.564794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1030/2052] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:28 2022] POST /identity/v3/projects => generated 369 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:28.570321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:28.680118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb256c6-b497-4eb6-ab51-7afad36453b7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.720443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:28.737596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90a34-bdc5-47a6-a1ec-13fd020d1714 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.759707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.760344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.760620 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.760890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.761608 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.771585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.810640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1031/2053] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:28 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:28.815681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:28.839706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4f3a8-3d9b-4dbc-a5df-9c5d53f43429 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.848564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.850674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.852239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.852866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.854425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.857206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.859244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.867161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.867573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.867952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.868976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.870900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.884824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1032/2054] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:28.889640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:28.930034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1023/2055] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:28 2022] POST /identity/v3/users => generated 294 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:28.931542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a3ac-c743-43e0-a06e-b0debdeb7b09 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.937044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:28.944443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.945878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.946924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.948815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.949507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.954632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.970031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae77eb-8653-4a8e-8362-f08af62325fe admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:28.985300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:28.991636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:28.991838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1033/2056] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:28.991924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:28.991924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:28.991924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:28.994408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:28.998373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:29.023589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1024/2057] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:29.024626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:29.032727 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e6611-8605-4bcc-9ab2-60ebe3b7550e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:29.046178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a449-0436-4c52-b1dc-b6932f5e3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:29.046998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a449-0436-4c52-b1dc-b6932f5e3477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:29.047284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a449-0436-4c52-b1dc-b6932f5e3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:29.047563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a449-0436-4c52-b1dc-b6932f5e3477 admin admin] PATH_INFO: `/v3/projects/e3dd64f217bc403599a0fde93a8d4088/users/f021b1b7e5054a83b43490cbbcbec095/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:29.048210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135704a-fbd5-4b12-b537-400430f2aec4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:29.060250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:29.060880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:29.061162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:29.061434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:29.062112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:29.065245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:29.105358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1025/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:29.108218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:29.110683 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a449-0436-4c52-b1dc-b6932f5e3477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dd64f217bc403599a0fde93a8d4088, user_id=f021b1b7e5054a83b43490cbbcbec095, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:29.117669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a449-0436-4c52-b1dc-b6932f5e3477 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:29.133128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb8cc7-6a72-487b-a584-d6a6705bff75 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:29.143651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1034/2059] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:28 2022] PUT /identity/v3/projects/e3dd64f217bc403599a0fde93a8d4088/users/f021b1b7e5054a83b43490cbbcbec095/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:29.150665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:29.151498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:29.151498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:29.206023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:29.207973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:29.300209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9f955-b9d2-4419-b9ab-28bedf90921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:29.301178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9f955-b9d2-4419-b9ab-28bedf90921b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:29.301688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9f955-b9d2-4419-b9ab-28bedf90921b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:29.302368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9f955-b9d2-4419-b9ab-28bedf90921b admin admin] PATH_INFO: `/v3/projects/bc5627becbaf4be09c6a76894de01288/users/e242a9345ddc47b697cc413114eae997/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:29.348950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9f955-b9d2-4419-b9ab-28bedf90921b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5627becbaf4be09c6a76894de01288, user_id=e242a9345ddc47b697cc413114eae997, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:29.351755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9f955-b9d2-4419-b9ab-28bedf90921b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:29.383371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1026/2060] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:29 2022] PUT /identity/v3/projects/bc5627becbaf4be09c6a76894de01288/users/e242a9345ddc47b697cc413114eae997/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:29.393595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ffbb-5ec8-4b8d-a6a2-63c5f159f5af None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:29.395446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ffbb-5ec8-4b8d-a6a2-63c5f159f5af None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:29.395736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4ffbb-5ec8-4b8d-a6a2-63c5f159f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:29.410946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:29.430492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1035/2061] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:29.445203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:29.450776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:29.485905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2cd4ffbb-5ec8-4b8d-a6a2-63c5f159f5af None None] MFA Rules not processed for user `e242a9345ddc47b697cc413114eae997`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:29.487198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2cd4ffbb-5ec8-4b8d-a6a2-63c5f159f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:29.554639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e064f5-08cc-4be9-9ec8-bd2b4185d7ad None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:29.636013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1027/2062] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:29.639556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ffbb-5ec8-4b8d-a6a2-63c5f159f5af None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:29.651978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:29.652147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:29.652807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:29.653122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:29.653372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:29.784800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:29.790318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:29.814915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1036/2063] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:29.825988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4ffbb-5ec8-4b8d-a6a2-63c5f159f5af None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:29.825988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:29.825988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:29.825988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:29.829532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:29.830331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:29.833143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:29.892393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1028/2064] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:29 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:29.897911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:29.914517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3840546-3d76-4295-ae07-eee131874add service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:30.098086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:30.105250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:30.105538 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:30.105816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:30.106850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:30.108806 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:30.145144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:30.188633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1037/2065] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:29 2022] POST /identity/v3/users => generated 299 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:30.190376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:30.206012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314581f7-a2cb-4439-b37a-0de80f3b6f91 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:30.229578 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:30.230237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:30.230523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:30.230871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:30.231602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:30.234382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:30.267115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1029/2066] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:30.272772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:30.296775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54063a88-b8c7-42f9-84b5-2ca0cd2a951b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:30.313722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:30.314638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:30.314945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:30.315217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] PATH_INFO: `/v3/projects/b4eba4c0065f4e67b23fb40447903db8/users/3918eeb8ac644dc18669a9006f2f9899/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:30.357938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eba4c0065f4e67b23fb40447903db8, user_id=3918eeb8ac644dc18669a9006f2f9899, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:30.361726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:30.391595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1038/2067] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:30 2022] PUT /identity/v3/projects/b4eba4c0065f4e67b23fb40447903db8/users/3918eeb8ac644dc18669a9006f2f9899/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:30.395418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:30.416015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225e7d-fded-4b13-a5fd-38723b548585 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:30.532871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceec50d-b37d-4675-89bd-5f408390370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:30.534747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceec50d-b37d-4675-89bd-5f408390370f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:30.535209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceec50d-b37d-4675-89bd-5f408390370f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:30.535627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceec50d-b37d-4675-89bd-5f408390370f admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:30.538154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceec50d-b37d-4675-89bd-5f408390370f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:30.540359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceec50d-b37d-4675-89bd-5f408390370f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:30.553766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1030/2068] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:30.558799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:30.573373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8304-488b-4e87-aca5-9f4f1c9c0fa4 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:30.581296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:30.582659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:30.583102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:30.584060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] PATH_INFO: `/v3/projects/b4eba4c0065f4e67b23fb40447903db8/users/3918eeb8ac644dc18669a9006f2f9899/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:30.586438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eba4c0065f4e67b23fb40447903db8, user_id=3918eeb8ac644dc18669a9006f2f9899, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:30.601899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:30.631224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1039/2069] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:30 2022] PUT /identity/v3/projects/b4eba4c0065f4e67b23fb40447903db8/users/3918eeb8ac644dc18669a9006f2f9899/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:30.631835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958b17-3628-4a96-95f4-10a1ef5aa617 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:30.632344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958b17-3628-4a96-95f4-10a1ef5aa617 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:30.632721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe958b17-3628-4a96-95f4-10a1ef5aa617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:30.687997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fe958b17-3628-4a96-95f4-10a1ef5aa617 None None] MFA Rules not processed for user `3918eeb8ac644dc18669a9006f2f9899`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:30.689957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fe958b17-3628-4a96-95f4-10a1ef5aa617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:30.803969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:30.810976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1031/2070] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:30.829464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:30.831483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:30.969386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9356640-956f-49f3-b80f-6121763b9b85 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:30.979382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:30.979382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:30.979382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:30.979382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:30.988924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:30.990645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:31.006259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1040/2071] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:31.269050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654d058-667c-43fb-b599-f7949b0e233b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:31.269333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654d058-667c-43fb-b599-f7949b0e233b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:31.269947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654d058-667c-43fb-b599-f7949b0e233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:31.312796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1654d058-667c-43fb-b599-f7949b0e233b None None] MFA Rules not processed for user `f021b1b7e5054a83b43490cbbcbec095`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:31.314552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1654d058-667c-43fb-b599-f7949b0e233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:31.414296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1032/2072] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:31.419114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:31.495377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768064c-1f68-4468-a153-23070107cdae service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:31.503309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:31.504052 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:31.504433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:31.506424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:31.506424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:31.508435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:31.542426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1041/2073] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:31 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:31.543647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654d058-667c-43fb-b599-f7949b0e233b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:31.556823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654d058-667c-43fb-b599-f7949b0e233b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:31.641736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:31.642520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:31.642784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:31.643059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:31.643847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:31.647199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:31.683130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1033/2074] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:31 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:31.684364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:31.710360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303cff4-5fb9-4a85-9b4b-e12b8fe2dbab admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:31.711471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:31.713949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:31.722740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:31.723357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:31.723639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:31.724451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:31.725116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:31.726779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:31.754239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1042/2075] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:31.759402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:31.780795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2023eb-0236-4177-bd60-a2c2774c079d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:31.791292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:31.792059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:31.792264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:31.792509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] PATH_INFO: `/v3/projects/5e53d114b82a43009f2275276cde9196/users/89425e9fbebc470ca664c77f12bcabc1/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:31.840259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e53d114b82a43009f2275276cde9196, user_id=89425e9fbebc470ca664c77f12bcabc1, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:31.844374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:31.849617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b1dfc-cff8-4774-9a4f-e989e095548f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:31.865635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:31.866485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:31.866821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:31.867205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:31.882715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1043/2076] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:31 2022] PUT /identity/v3/projects/5e53d114b82a43009f2275276cde9196/users/89425e9fbebc470ca664c77f12bcabc1/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:31.889002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:31.921602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:31.925614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:31.986987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:31.991887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:32.007897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1034/2077] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:32.014965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37128a50-ee17-4790-ab24-312306bc9f9a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:32.020159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c98d85-7502-4ef7-8e4c-5d1a25eda56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:32.020778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98d85-7502-4ef7-8e4c-5d1a25eda56c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:32.021482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98d85-7502-4ef7-8e4c-5d1a25eda56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:32.021877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98d85-7502-4ef7-8e4c-5d1a25eda56c admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:32.022896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c98d85-7502-4ef7-8e4c-5d1a25eda56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:32.024649 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c98d85-7502-4ef7-8e4c-5d1a25eda56c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:32.038696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1044/2078] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:32.039986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:32.051336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dd1e2-6e78-4e4f-b5d0-a9621fbfb2da service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:32.061265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd66022-91d7-4293-9ca0-ade712ed6493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:32.062088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd66022-91d7-4293-9ca0-ade712ed6493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:32.062456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd66022-91d7-4293-9ca0-ade712ed6493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:32.062811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd66022-91d7-4293-9ca0-ade712ed6493 admin admin] PATH_INFO: `/v3/projects/5e53d114b82a43009f2275276cde9196/users/89425e9fbebc470ca664c77f12bcabc1/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:32.065374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd66022-91d7-4293-9ca0-ade712ed6493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e53d114b82a43009f2275276cde9196, user_id=89425e9fbebc470ca664c77f12bcabc1, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:32.081373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd66022-91d7-4293-9ca0-ade712ed6493 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:32.108471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1035/2079] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:32 2022] PUT /identity/v3/projects/5e53d114b82a43009f2275276cde9196/users/89425e9fbebc470ca664c77f12bcabc1/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:33.972636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:33.973081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:33.973202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:34.046668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] MFA Rules not processed for user `89425e9fbebc470ca664c77f12bcabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:34.047985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:34.176032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1045/2080] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:34.186482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:34.187000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:34.187000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:34.210998 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] MFA Rules not processed for user `f021b1b7e5054a83b43490cbbcbec095`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:34.212166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:34.276267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1036/2081] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:34.287013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:34.288753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:34.389109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b36e2-9a0a-4f1d-af51-cd67f3a02700 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:34.408974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a9da-eaac-4e3f-9e75-139156bc869d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:34.409701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a9da-eaac-4e3f-9e75-139156bc869d service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:34.410072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a9da-eaac-4e3f-9e75-139156bc869d service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:34.410566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a9da-eaac-4e3f-9e75-139156bc869d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:34.424014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a9da-eaac-4e3f-9e75-139156bc869d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:34.427809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a9da-eaac-4e3f-9e75-139156bc869d service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:34.445890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1046/2082] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:35.617245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:35.619292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:35.712808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa11def-70b9-44d6-ad72-3f19437c5887 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:35.720346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:35.721167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:35.721450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:35.721720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] PATH_INFO: `/v3/users/3311feea4091425d8f1545d2071a4a9c` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:35.723195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3311feea4091425d8f1545d2071a4a9c)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:35.725543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:35.785433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3311feea4091425d8f1545d2071a4a9c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:35.786635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3311feea4091425d8f1545d2071a4a9c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:35.787430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3311feea4091425d8f1545d2071a4a9c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:35.795773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3311feea4091425d8f1545d2071a4a9c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:35.804348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3311feea4091425d8f1545d2071a4a9c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:35.810167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:35.829655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1037/2083] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:35 2022] DELETE /identity/v3/users/3311feea4091425d8f1545d2071a4a9c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:35.835225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:35.835729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:35.835809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:35.855678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:35.856898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:35.881902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:35.950104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1047/2084] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:35.959038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:35.960680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:36.036633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e46002-be5e-460c-aa53-5cb6c539c07f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:36.040545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:36.041153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:36.041492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:36.041772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:36.051056 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:36.053098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:36.065348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1038/2085] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:36.424593 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:36.426173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:36.456517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba5bb-087f-49cf-ba4c-6abece613531 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:36.462564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:36.463279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:36.463548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:36.463870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] PATH_INFO: `/v3/projects/9caa57103f19405b8d9aa4bbdeb1cdae` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:36.465223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9caa57103f19405b8d9aa4bbdeb1cdae)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:36.467891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:36.588369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9caa57103f19405b8d9aa4bbdeb1cdae', 'request_id': 'req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:36.605967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:36.608063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:36.610568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9caa57103f19405b8d9aa4bbdeb1cdae', 'request_id': 'req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:36.647567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9caa57103f19405b8d9aa4bbdeb1cdae', 'request_id': 'req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:36.673614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] The token cache is being invalidate because project 9caa57103f19405b8d9aa4bbdeb1cdae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:36.678078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:36.679083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e95f8338-57f5-4623-a7a4-d84a9b5b6ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:36.683104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1048/2086] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:36 2022] DELETE /identity/v3/projects/9caa57103f19405b8d9aa4bbdeb1cdae => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:36.693040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e9a0-2bb4-4bd0-a58c-3dccf30024f4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:36.695284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e9a0-2bb4-4bd0-a58c-3dccf30024f4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:36.695849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e9a0-2bb4-4bd0-a58c-3dccf30024f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:36.772588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fd86-14f0-40c9-bacc-3b892e26c923 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:36.776101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-7524e9a0-2bb4-4bd0-a58c-3dccf30024f4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:36.779504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7524e9a0-2bb4-4bd0-a58c-3dccf30024f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:36.938176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1049/2087] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:36.945186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0badfe-68f7-4dcb-a3f3-0ae7d65b53a3 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:36.945799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0badfe-68f7-4dcb-a3f3-0ae7d65b53a3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:36.946413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0badfe-68f7-4dcb-a3f3-0ae7d65b53a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:36.978959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:36.981496 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:36.981773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:36.982036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:36.987267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:37.001376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5d0badfe-68f7-4dcb-a3f3-0ae7d65b53a3 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:37.003717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5d0badfe-68f7-4dcb-a3f3-0ae7d65b53a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:37.031083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1050/2088] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:37.032246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0badfe-68f7-4dcb-a3f3-0ae7d65b53a3 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.050466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0badfe-68f7-4dcb-a3f3-0ae7d65b53a3 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.064868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.065586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.065864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.066278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.068005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:37.068005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.072057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.108383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1051/2089] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:29:37.110682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.118994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.120530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.125736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:37.134744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1039/2090] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:37.148634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987238a-e790-4b8f-9abb-379ce3fd458f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.160706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.163176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.163176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.163176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.163847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.165790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.231280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:37.262562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1052/2091] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:37 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:37.263915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.286788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da001e59-9df6-49e7-a138-4a6aa45bb1e1 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.374811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.376124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.376485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.376904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.377352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.379852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.407532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1040/2092] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:37 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:37.411422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.425899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be9601-d69b-49c7-907d-38089120fd25 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.433906 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.435246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.435529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.435909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.436688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.438549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.454853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1053/2093] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:37.454958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.467453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f27ec-5d52-4cc6-9df5-978f86d36752 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.474508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.475239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.475585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.475934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.476648 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.478848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.492203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1041/2094] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:37.496864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.503170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.505137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:37.511523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c3b1b-4247-4caf-9f9d-c69922b5b605 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.517055 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548deb76-d561-4ed4-b612-42385f4319bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.517786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548deb76-d561-4ed4-b612-42385f4319bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.518173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548deb76-d561-4ed4-b612-42385f4319bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.518453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548deb76-d561-4ed4-b612-42385f4319bf admin admin] PATH_INFO: `/v3/projects/fab1effc235a4a90b98bf2a89f5e39bd/users/0508dadbb3dc45b1bdf4d4fe83c4dac3/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.518790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74588e3-1228-4357-9ed3-b12e5990f6ba admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.525048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.525687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.525970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.526322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] PATH_INFO: `/v3/users/bd4d957239e1473abbe1b8e2b2fce104` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.527451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4d957239e1473abbe1b8e2b2fce104)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.529394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.534809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548deb76-d561-4ed4-b612-42385f4319bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab1effc235a4a90b98bf2a89f5e39bd, user_id=0508dadbb3dc45b1bdf4d4fe83c4dac3, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.537754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548deb76-d561-4ed4-b612-42385f4319bf admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:37.552631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1054/2095] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:37 2022] PUT /identity/v3/projects/fab1effc235a4a90b98bf2a89f5e39bd/users/0508dadbb3dc45b1bdf4d4fe83c4dac3/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:37.557494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.557781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.558044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.579065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:37.580264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:37.588263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4d957239e1473abbe1b8e2b2fce104'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:37.588933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4d957239e1473abbe1b8e2b2fce104'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:37.589544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4d957239e1473abbe1b8e2b2fce104'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:37.597425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4d957239e1473abbe1b8e2b2fce104'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:37.610731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4d957239e1473abbe1b8e2b2fce104'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:37.640402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1042/2096] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:37 2022] DELETE /identity/v3/users/bd4d957239e1473abbe1b8e2b2fce104 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:37.715550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1055/2097] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:37.728358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.730844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:37.854220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:37.859827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fae0d-3a48-4e1d-91d4-3538f825f914 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.868119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00494c-d716-426f-9593-7c6ba84be5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:37.870157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00494c-d716-426f-9593-7c6ba84be5db service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:37.871294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00494c-d716-426f-9593-7c6ba84be5db service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:37.871570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00494c-d716-426f-9593-7c6ba84be5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:37.967128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:37.968674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:37.988401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9e34e-c404-45c7-aa51-edb357f3a910 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:37.994553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00494c-d716-426f-9593-7c6ba84be5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:37.998561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00494c-d716-426f-9593-7c6ba84be5db service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.007091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:38.007748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.008028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.008302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] PATH_INFO: `/v3/projects/16bc6a44e41846ecaa70b7d051973f21` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.009465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bc6a44e41846ecaa70b7d051973f21)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:38.011610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.026201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1043/2098] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:38.121359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bc6a44e41846ecaa70b7d051973f21', 'request_id': 'req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:38.132040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bc6a44e41846ecaa70b7d051973f21', 'request_id': 'req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:38.144442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bc6a44e41846ecaa70b7d051973f21', 'request_id': 'req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:38.158455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] The token cache is being invalidate because project 16bc6a44e41846ecaa70b7d051973f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:38.158766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:38.159463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ceda20a7-0736-4f00-ba9d-03bf4a3e8109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:38.161660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1056/2099] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:37 2022] DELETE /identity/v3/projects/16bc6a44e41846ecaa70b7d051973f21 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:38.178632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbaa88-c243-4203-a517-223ed005425c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.179728 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbaa88-c243-4203-a517-223ed005425c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.180424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbaa88-c243-4203-a517-223ed005425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.208629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-53fbaa88-c243-4203-a517-223ed005425c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:38.210211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-53fbaa88-c243-4203-a517-223ed005425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:38.321814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1044/2100] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:38.332023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7ad76-f4e8-4751-9479-7da31b65b114 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.332311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7ad76-f4e8-4751-9479-7da31b65b114 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.332612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7ad76-f4e8-4751-9479-7da31b65b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.359328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d9b7ad76-f4e8-4751-9479-7da31b65b114 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:38.362706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d9b7ad76-f4e8-4751-9479-7da31b65b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:38.377231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1057/2101] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:38.379169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbaa88-c243-4203-a517-223ed005425c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:38.392467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbaa88-c243-4203-a517-223ed005425c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:38.398603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:38.399317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.399796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.400144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.401342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:38.401782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:38.403535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.422107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1045/2102] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:29:38.425508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7ad76-f4e8-4751-9479-7da31b65b114 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:38.439494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7ad76-f4e8-4751-9479-7da31b65b114 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:38.449670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:38.449670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.449670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.450251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.450714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:38.452368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.497351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1058/2103] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:38 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:38.500605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:38.514691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc67d-bcd7-4674-99f2-08e14379ff85 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:38.597702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:38.598381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.598710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.599183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.600269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:38.602184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.637495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1046/2104] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:38 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:38.638724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:38.651759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4fb40-4fda-4822-a025-8137de733059 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:38.656711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:38.657413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.657758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.658358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.659036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:38.660682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.673713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1059/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:38.677513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:38.688487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f84f73-7d89-4f84-9c3f-59f904e6ce79 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:38.695075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b35130-0da2-4f83-9fad-46bbd98e5447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:38.695811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b35130-0da2-4f83-9fad-46bbd98e5447 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.696097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b35130-0da2-4f83-9fad-46bbd98e5447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.696452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b35130-0da2-4f83-9fad-46bbd98e5447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.697131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b35130-0da2-4f83-9fad-46bbd98e5447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:38.698879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b35130-0da2-4f83-9fad-46bbd98e5447 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.712368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1047/2106] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:38.716935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:38.729221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6d1c6-b03e-4fde-b67d-cd7983beac82 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:38.734097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:38.734823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.735109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.735382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] PATH_INFO: `/v3/projects/0d5f1cde39724f7c91269fddfc19d5dd/users/5a236711f9c84a3daaa7559c253aa2b7/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.738656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:38.756650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5f1cde39724f7c91269fddfc19d5dd, user_id=5a236711f9c84a3daaa7559c253aa2b7, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:38.759638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:38.783785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1060/2107] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:38 2022] PUT /identity/v3/projects/0d5f1cde39724f7c91269fddfc19d5dd/users/5a236711f9c84a3daaa7559c253aa2b7/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:38.799297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cdc5b-9395-430d-a9a9-872318d2bbe3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:38.800073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cdc5b-9395-430d-a9a9-872318d2bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:38.800301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1cdc5b-9395-430d-a9a9-872318d2bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:38.809572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:38.842170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0d1cdc5b-9395-430d-a9a9-872318d2bbe3 None None] MFA Rules not processed for user `5a236711f9c84a3daaa7559c253aa2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:38.843507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0d1cdc5b-9395-430d-a9a9-872318d2bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:38.936320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1048/2108] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:38.940553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:39.013726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc1247-377f-4d2a-84e5-f85c6f05607f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:39.018743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:39.019430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:39.019855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:39.020746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:39.021456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:39.023507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:39.063425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1061/2109] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:38 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:39.067883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cdc5b-9395-430d-a9a9-872318d2bbe3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:39.080396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1cdc5b-9395-430d-a9a9-872318d2bbe3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:39.163661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:39.164589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:39.165161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:39.165750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:39.166491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:39.168731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:39.216966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1049/2110] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:39 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:39.221040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:39.235604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcf333-25c8-48bf-b154-bee962d0af04 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:39.241606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:39.242460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:39.242675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:39.242949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:39.243751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:39.245580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:39.264428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1062/2111] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:39.265690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:39.280505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438131b-159e-4ebe-92f3-3c288b920278 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:39.289229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:39.290150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:39.290592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:39.291035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] PATH_INFO: `/v3/projects/2a1afe6d67a44a2cb6bb68c25e2b19b2/users/1090ab8f74904a6c977d88a32831d2e2/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:39.309386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1afe6d67a44a2cb6bb68c25e2b19b2, user_id=1090ab8f74904a6c977d88a32831d2e2, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:39.319810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:39.345314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1050/2112] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:39 2022] PUT /identity/v3/projects/2a1afe6d67a44a2cb6bb68c25e2b19b2/users/1090ab8f74904a6c977d88a32831d2e2/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:39.350074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:39.365650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635cf71-c3d3-48b5-a8d3-30629eae76a6 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:39.481133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e77db-b1d5-4678-ad4f-3ef113db27a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:39.482034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e77db-b1d5-4678-ad4f-3ef113db27a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:39.482494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e77db-b1d5-4678-ad4f-3ef113db27a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:39.482934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e77db-b1d5-4678-ad4f-3ef113db27a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:39.483722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e77db-b1d5-4678-ad4f-3ef113db27a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:39.485837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e77db-b1d5-4678-ad4f-3ef113db27a9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:39.503695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1063/2113] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:39.505027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:39.532741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a5c4-b139-4361-8b49-333a06aaedee admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:39.561304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:39.562101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:39.562452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:39.562730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] PATH_INFO: `/v3/projects/2a1afe6d67a44a2cb6bb68c25e2b19b2/users/1090ab8f74904a6c977d88a32831d2e2/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:39.577533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1afe6d67a44a2cb6bb68c25e2b19b2, user_id=1090ab8f74904a6c977d88a32831d2e2, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:39.583375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:39.618031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1051/2114] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:39 2022] PUT /identity/v3/projects/2a1afe6d67a44a2cb6bb68c25e2b19b2/users/1090ab8f74904a6c977d88a32831d2e2/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:39.634224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:39.634733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:39.635081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:39.708141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] MFA Rules not processed for user `1090ab8f74904a6c977d88a32831d2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:39.715659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:39.852109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:39.930126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1064/2115] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:39 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:39.946672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:39.949165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:40.099048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:40.112614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f7a06-7a5f-439a-b9d4-54d6e5023ba9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:40.119041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:40.119669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:40.119946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:40.120215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:40.156332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:40.156332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:40.199174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1052/2116] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:40.219969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:40.221473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:40.310029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:40.390384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995448fc-9d35-4a29-8dce-ecf05a96cdc1 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:40.399149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:40.400612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:40.401075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:40.401599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] PATH_INFO: `/v3/users/0759b54edec14d6ea201a9a4e9b561ba` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:40.403380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0759b54edec14d6ea201a9a4e9b561ba)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:40.406456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:40.447349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e8259-8229-480e-91aa-af02981a82bc service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:40.460474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:40.462977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:40.464387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:40.465625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] PATH_INFO: `/v3/users/5a236711f9c84a3daaa7559c253aa2b7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:40.468491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a236711f9c84a3daaa7559c253aa2b7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:40.474753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:40.493702 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0759b54edec14d6ea201a9a4e9b561ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.504073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0759b54edec14d6ea201a9a4e9b561ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.512194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0759b54edec14d6ea201a9a4e9b561ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.528224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0759b54edec14d6ea201a9a4e9b561ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.529473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d9e7f779-0c9e-484f-9fc2-d58be4c606b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0759b54edec14d6ea201a9a4e9b561ba'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.563963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1065/2117] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:40 2022] DELETE /identity/v3/users/0759b54edec14d6ea201a9a4e9b561ba => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:40.568432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:40.568721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:40.568994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:40.580790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a236711f9c84a3daaa7559c253aa2b7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.584839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a236711f9c84a3daaa7559c253aa2b7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.589635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a236711f9c84a3daaa7559c253aa2b7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.606324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a236711f9c84a3daaa7559c253aa2b7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.617133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-11e5c814-c34b-4122-b45c-5fb0cfa49e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a236711f9c84a3daaa7559c253aa2b7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:40.619064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:40.622569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:40.652976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1053/2118] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:40 2022] DELETE /identity/v3/users/5a236711f9c84a3daaa7559c253aa2b7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:40.656861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:40.657599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:40.657599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:40.695904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:40.697136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:40.749004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:40.766848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1066/2119] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:40.780962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:40.783001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:40.867282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1054/2120] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:40.891142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e2eb-d8fc-47b5-b537-83320dad68f0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:40.892371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:40.894173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:40.920419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:41.000429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b13be-ed03-49e9-afc9-1a1caec0f03f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:41.009895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:41.010647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:41.010999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:41.011342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:41.015328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:41.015891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:41.016172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:41.016446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:41.027608 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:41.028896 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:41.029549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:41.030367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:41.062930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1067/2121] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:41.070138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1055/2122] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:41.385731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:41.388227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:41.403508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f80fd-2515-4fed-b6d9-910fb4c10771 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:41.409009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:41.409650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:41.409929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:41.410308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] PATH_INFO: `/v3/projects/b40f5ab0e371440e9bef58a7e4b26854` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:41.412323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40f5ab0e371440e9bef58a7e4b26854)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:41.414306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:41.477701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40f5ab0e371440e9bef58a7e4b26854', 'request_id': 'req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.485458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40f5ab0e371440e9bef58a7e4b26854', 'request_id': 'req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.494720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40f5ab0e371440e9bef58a7e4b26854', 'request_id': 'req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.506584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] The token cache is being invalidate because project b40f5ab0e371440e9bef58a7e4b26854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:41.506870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.507505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.512515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1068/2123] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:41 2022] DELETE /identity/v3/projects/b40f5ab0e371440e9bef58a7e4b26854 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:41.513289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:41.523720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee99ce-d553-4a74-8e76-6992a1153873 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:41.588085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:41.588874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:41.589227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:41.589749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] PATH_INFO: `/v3/users/e242a9345ddc47b697cc413114eae997` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:41.592597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e242a9345ddc47b697cc413114eae997)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:41.596331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:41.688312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e242a9345ddc47b697cc413114eae997'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.689697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e242a9345ddc47b697cc413114eae997'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.690590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e242a9345ddc47b697cc413114eae997'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.701073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e242a9345ddc47b697cc413114eae997'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.713851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e242a9345ddc47b697cc413114eae997'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:41.741744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1056/2124] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:41 2022] DELETE /identity/v3/users/e242a9345ddc47b697cc413114eae997 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:42.289079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:42.290589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:42.322916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b18c75-0f6c-4407-9a91-2a7ee568aefa admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:42.414124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:42.416282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:42.429895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:42.466996 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:42.468400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:42.477200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:42.477740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] PATH_INFO: `/v3/projects/0d5f1cde39724f7c91269fddfc19d5dd` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:42.479825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5f1cde39724f7c91269fddfc19d5dd)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:42.488750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:42.500529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:42.563444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db548-3770-4a4c-b18a-836b7ab505bb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:42.581506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:42.584397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:42.584562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:42.584847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] PATH_INFO: `/v3/projects/bc5627becbaf4be09c6a76894de01288` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:42.588791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5627becbaf4be09c6a76894de01288)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:42.591841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:42.607968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5f1cde39724f7c91269fddfc19d5dd', 'request_id': 'req-71c70613-fec4-4653-bc46-42486a49b7e1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.615516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5f1cde39724f7c91269fddfc19d5dd', 'request_id': 'req-71c70613-fec4-4653-bc46-42486a49b7e1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.636300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5f1cde39724f7c91269fddfc19d5dd', 'request_id': 'req-71c70613-fec4-4653-bc46-42486a49b7e1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.675557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] The token cache is being invalidate because project 0d5f1cde39724f7c91269fddfc19d5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:42.675557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.678454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.686740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1069/2125] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:42 2022] DELETE /identity/v3/projects/0d5f1cde39724f7c91269fddfc19d5dd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:42.691505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:42.697682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:42.706663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5627becbaf4be09c6a76894de01288', 'request_id': 'req-0f14304c-ad64-4b77-b7ce-bab95d6fa322'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.729942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5627becbaf4be09c6a76894de01288', 'request_id': 'req-0f14304c-ad64-4b77-b7ce-bab95d6fa322'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.740432 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5627becbaf4be09c6a76894de01288', 'request_id': 'req-0f14304c-ad64-4b77-b7ce-bab95d6fa322'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.766216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] The token cache is being invalidate because project bc5627becbaf4be09c6a76894de01288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:42.766509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.768015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:42.771890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1057/2126] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:42 2022] DELETE /identity/v3/projects/bc5627becbaf4be09c6a76894de01288 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:42.776364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:42.779753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:42.876274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c70613-fec4-4653-bc46-42486a49b7e1 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:42.892679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:42.893366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:42.893770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:42.893968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] PATH_INFO: `/v3/users/1090ab8f74904a6c977d88a32831d2e2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:42.895365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1090ab8f74904a6c977d88a32831d2e2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:42.900204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:42.906323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14304c-ad64-4b77-b7ce-bab95d6fa322 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:42.914638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:42.921401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:42.921893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:42.922405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] PATH_INFO: `/v3/users/3918eeb8ac644dc18669a9006f2f9899` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:42.924282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3918eeb8ac644dc18669a9006f2f9899)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:42.927508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:43.018855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3918eeb8ac644dc18669a9006f2f9899'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.019955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3918eeb8ac644dc18669a9006f2f9899'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.020959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3918eeb8ac644dc18669a9006f2f9899'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.022322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1090ab8f74904a6c977d88a32831d2e2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.046020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3918eeb8ac644dc18669a9006f2f9899'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.050087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1090ab8f74904a6c977d88a32831d2e2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.051467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1090ab8f74904a6c977d88a32831d2e2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.057489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3918eeb8ac644dc18669a9006f2f9899'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.063763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:43.075050 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1090ab8f74904a6c977d88a32831d2e2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.078006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1090ab8f74904a6c977d88a32831d2e2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.090775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:43.108770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1058/2127] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:42 2022] DELETE /identity/v3/users/3918eeb8ac644dc18669a9006f2f9899 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:43.114674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1070/2128] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:42 2022] DELETE /identity/v3/users/1090ab8f74904a6c977d88a32831d2e2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:43.679263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:43.681546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:43.715885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:43.718959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:43.811969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ddbba-5b22-4048-8eba-96fdfe1ce8f9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:43.861719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00038f5-fffd-47dc-bf33-21038c66f674 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:43.868836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:43.870156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:43.870594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:43.871149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] PATH_INFO: `/v3/projects/2a1afe6d67a44a2cb6bb68c25e2b19b2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:43.872604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1afe6d67a44a2cb6bb68c25e2b19b2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:43.874951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:43.914886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:43.916160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:43.916610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:43.916890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] PATH_INFO: `/v3/projects/b4eba4c0065f4e67b23fb40447903db8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:43.918381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4eba4c0065f4e67b23fb40447903db8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:43.920763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:43.947074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1afe6d67a44a2cb6bb68c25e2b19b2', 'request_id': 'req-2ec07eba-481a-4587-8824-7aa7cef83825'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.958089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1afe6d67a44a2cb6bb68c25e2b19b2', 'request_id': 'req-2ec07eba-481a-4587-8824-7aa7cef83825'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.971002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1afe6d67a44a2cb6bb68c25e2b19b2', 'request_id': 'req-2ec07eba-481a-4587-8824-7aa7cef83825'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.987398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] The token cache is being invalidate because project 2a1afe6d67a44a2cb6bb68c25e2b19b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:43.988045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.989638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2ec07eba-481a-4587-8824-7aa7cef83825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.991566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1071/2129] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:43 2022] DELETE /identity/v3/projects/2a1afe6d67a44a2cb6bb68c25e2b19b2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:43.994862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4eba4c0065f4e67b23fb40447903db8', 'request_id': 'req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:43.996481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a202b-d9cb-4cde-b19a-e4bd1b067ab1 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:43.996916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a202b-d9cb-4cde-b19a-e4bd1b067ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:43.997329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a202b-d9cb-4cde-b19a-e4bd1b067ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.003333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4eba4c0065f4e67b23fb40447903db8', 'request_id': 'req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:44.015983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4eba4c0065f4e67b23fb40447903db8', 'request_id': 'req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:44.022868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-5e1a202b-d9cb-4cde-b19a-e4bd1b067ab1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:44.024088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-5e1a202b-d9cb-4cde-b19a-e4bd1b067ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:44.033051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] The token cache is being invalidate because project b4eba4c0065f4e67b23fb40447903db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:44.033359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:44.034340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ab98ad9f-da7f-4bad-ab06-d416058ca7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:44.037313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1059/2130] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:43 2022] DELETE /identity/v3/projects/b4eba4c0065f4e67b23fb40447903db8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:44.043386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f86a38-d44b-4567-b9b3-3e1a31b3da06 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.043688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f86a38-d44b-4567-b9b3-3e1a31b3da06 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.043937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f86a38-d44b-4567-b9b3-3e1a31b3da06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.069813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d6f86a38-d44b-4567-b9b3-3e1a31b3da06 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:44.071250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d6f86a38-d44b-4567-b9b3-3e1a31b3da06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:44.106073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:44.140400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1072/2131] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:44.145956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88256f47-d992-47fc-a08d-7177bfe1b2c5 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.146300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88256f47-d992-47fc-a08d-7177bfe1b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.146501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88256f47-d992-47fc-a08d-7177bfe1b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.188941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-88256f47-d992-47fc-a08d-7177bfe1b2c5 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:44.190268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-88256f47-d992-47fc-a08d-7177bfe1b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:44.203126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1060/2132] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:44.212467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68011d-fc71-4ba7-89e9-44fb33ce7a15 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.212815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68011d-fc71-4ba7-89e9-44fb33ce7a15 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.213168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68011d-fc71-4ba7-89e9-44fb33ce7a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.215062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1073/2133] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:44.215990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88256f47-d992-47fc-a08d-7177bfe1b2c5 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.234983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88256f47-d992-47fc-a08d-7177bfe1b2c5 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.251256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.252614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.253195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.253898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.256706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:44.259039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.264719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4f68011d-fc71-4ba7-89e9-44fb33ce7a15 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:44.266983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4f68011d-fc71-4ba7-89e9-44fb33ce7a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:44.269857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.291005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1074/2134] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:44.293348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1061/2135] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:44.298815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68011d-fc71-4ba7-89e9-44fb33ce7a15 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.299685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.309903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68011d-fc71-4ba7-89e9-44fb33ce7a15 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.313005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:44.315045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.315853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.316209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.316582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.317749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:44.318284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.319889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.324651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643898a9-529c-4078-8bc4-3a3e8dddcf3f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.330639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.331656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.331928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.333079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.334498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.337355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.337801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1062/2136] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:44.338782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.350630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afa05e-660d-4e4d-ab65-cd9c4aa11233 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.366696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.367726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.368114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.368338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.369677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.372543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.401443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1075/2137] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:44.406723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.420656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1063/2138] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:44.422267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.521510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2052c-d4e8-4e52-b7c0-1ba77bfb400e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.530155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.530357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2368bf-d0ca-4c22-9ce9-80e65f099e43 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.531262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.531752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.532158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.533402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.536631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.537799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.538024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.538463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.539198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.539383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.541377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.574437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1076/2140] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:44.575880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.577289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1064/2139] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:44.578464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.589153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7329228-4e37-410a-8b07-7ff9915c4fa4 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.591347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddd5a9-3a69-4530-8b08-e4c9ee6299e4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.594799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.595663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.596022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.596387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.597128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.597267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.598600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.599109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.599866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.600126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.600560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.601846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.615924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1077/2141] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:44.617192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.622712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1065/2142] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:44.628325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.638984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29873e6-c24e-4486-aac4-c20c96873875 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.650150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.652062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.653733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1dc378-f049-481e-ae55-db5d289311ae admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.654110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.654473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.661391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.661391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.666794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.668109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.668848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.669302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.670507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.672501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.684898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1066/2143] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:44.689320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.689863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1078/2144] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:44.692987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.704587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7809130-a3e9-48c9-9eae-aa7244589c46 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.709596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00029ac7-398e-4a2b-84b7-c5c5f43a6563 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:44.714722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbbaf1-334a-4dc6-aa24-603b2f0d89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.715409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345e280-9625-4808-a233-a72670f60287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:44.715878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbbaf1-334a-4dc6-aa24-603b2f0d89b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.716267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345e280-9625-4808-a233-a72670f60287 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.716531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbbaf1-334a-4dc6-aa24-603b2f0d89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.717034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345e280-9625-4808-a233-a72670f60287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.717034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345e280-9625-4808-a233-a72670f60287 admin admin] PATH_INFO: `/v3/projects/2b7573ecaf6f4782a7c9fbfb7128bbd1/users/6bd8297e21774a8084f9168fae51ef04/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.717575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbbaf1-334a-4dc6-aa24-603b2f0d89b3 admin admin] PATH_INFO: `/v3/projects/5a667a3c96a24a028db7a7d77bfe0fa0/users/6b03c738a3a94dbf97e93c644a8b3567/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.738944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbbaf1-334a-4dc6-aa24-603b2f0d89b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a667a3c96a24a028db7a7d77bfe0fa0, user_id=6b03c738a3a94dbf97e93c644a8b3567, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.741455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345e280-9625-4808-a233-a72670f60287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7573ecaf6f4782a7c9fbfb7128bbd1, user_id=6bd8297e21774a8084f9168fae51ef04, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:44.741878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbbaf1-334a-4dc6-aa24-603b2f0d89b3 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.744884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345e280-9625-4808-a233-a72670f60287 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:44.779502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1067/2146] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:44 2022] PUT /identity/v3/projects/2b7573ecaf6f4782a7c9fbfb7128bbd1/users/6bd8297e21774a8084f9168fae51ef04/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:44.781453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1079/2146] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:44 2022] PUT /identity/v3/projects/5a667a3c96a24a028db7a7d77bfe0fa0/users/6b03c738a3a94dbf97e93c644a8b3567/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:44.781779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12ef7-a11a-4cd7-b6ca-4461049e40e2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.782086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12ef7-a11a-4cd7-b6ca-4461049e40e2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.782366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce12ef7-a11a-4cd7-b6ca-4461049e40e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.785419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814ef1-fea4-43da-a0fc-abe90e98e3dd None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:44.786339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814ef1-fea4-43da-a0fc-abe90e98e3dd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:44.786987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4814ef1-fea4-43da-a0fc-abe90e98e3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:44.819736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7ce12ef7-a11a-4cd7-b6ca-4461049e40e2 None None] MFA Rules not processed for user `6bd8297e21774a8084f9168fae51ef04`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:44.820977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7ce12ef7-a11a-4cd7-b6ca-4461049e40e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:44.832227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:44.835087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a4814ef1-fea4-43da-a0fc-abe90e98e3dd None None] MFA Rules not processed for user `6b03c738a3a94dbf97e93c644a8b3567`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:44.836434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a4814ef1-fea4-43da-a0fc-abe90e98e3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:44.939273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1068/2147] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:44.943554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce12ef7-a11a-4cd7-b6ca-4461049e40e2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:44.987036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1080/2148] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:44.992766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814ef1-fea4-43da-a0fc-abe90e98e3dd None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.022857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:45.034904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce12ef7-a11a-4cd7-b6ca-4461049e40e2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.048988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.049757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.050177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.050557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.052028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.065865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.096865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4814ef1-fea4-43da-a0fc-abe90e98e3dd None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.103764 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.104991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.105673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.106200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.107026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.110203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.121102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1069/2149] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:45.139582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.176712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1081/2150] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:44 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:45.180014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.246622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a64345-6a26-4157-883d-faf3eb8e9ea2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.280597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9a2ee-8118-43ed-a455-68664f4b0054 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.287955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.289588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.289869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.290179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.290941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.293558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.302829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:45.328676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1082/2151] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:45 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:29:45.328900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.329343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.329708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.330003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.330336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.331040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.335614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.343030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38749383-b2ac-4672-9f10-7a1dda5c5aad admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.349116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.349949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.350399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.350772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.352079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.354646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.367547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1070/2152] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:45 2022] POST /identity/v3/users => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:45.371820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.375926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1083/2153] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:45.382448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.384757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ee7ff-3cad-4496-bbff-4359d9bfc383 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.390783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.391192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.391636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.392259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.393172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.395159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.398601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6170-e501-4e35-94c1-4310175486d6 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.405582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.406308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.406595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.406941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] PATH_INFO: `/v3/projects/72d3b8e123be48b1813cb51bc105fa69/users/d19e3f0e8d0947858e711714d9f66461/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.413231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1071/2154] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:45.415501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.431407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d3b8e123be48b1813cb51bc105fa69, user_id=d19e3f0e8d0947858e711714d9f66461, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.435951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.445048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f95aa-92cb-4e97-a8c9-ec8f5f370b03 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.450492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.451211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.452170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.452170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] PATH_INFO: `/v3/projects/e6acc42e41034bf8ac680ba52125ff1b/users/0954dc239a654dc788d9272e97cef668/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.460177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1084/2155] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:45 2022] PUT /identity/v3/projects/72d3b8e123be48b1813cb51bc105fa69/users/d19e3f0e8d0947858e711714d9f66461/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:45.465098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.477574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6acc42e41034bf8ac680ba52125ff1b, user_id=0954dc239a654dc788d9272e97cef668, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.480943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.500898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1072/2156] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:45 2022] PUT /identity/v3/projects/e6acc42e41034bf8ac680ba52125ff1b/users/0954dc239a654dc788d9272e97cef668/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:45.506406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.606496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:45.621706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26787c9-5140-45f5-bcf3-5234ecd9a74b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.631035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.631949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.632231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.632786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.637164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6f4bf-3302-40ce-93b4-ba6115aa4bfe admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.638499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.641034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.647608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.648485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.650611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.651674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.652525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.654345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.656458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1085/2157] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:45.660919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.679608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1073/2158] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:45.680819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:45.687564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422cb10-d559-4292-99cd-2d449cacd9ab admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.701698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd9c0e-fcc0-41a3-a2ea-ba6302de8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.702407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9c0e-fcc0-41a3-a2ea-ba6302de8fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.702718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9c0e-fcc0-41a3-a2ea-ba6302de8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.702968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd9c0e-fcc0-41a3-a2ea-ba6302de8fa4 admin admin] PATH_INFO: `/v3/projects/72d3b8e123be48b1813cb51bc105fa69/users/d19e3f0e8d0947858e711714d9f66461/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.704802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656ad28-b11b-4867-842e-d8ed04de4172 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:45.708895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd9c0e-fcc0-41a3-a2ea-ba6302de8fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d3b8e123be48b1813cb51bc105fa69, user_id=d19e3f0e8d0947858e711714d9f66461, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.711647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd9c0e-fcc0-41a3-a2ea-ba6302de8fa4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.718697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb079174-810b-4031-948c-aa38d6243522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:45.719457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb079174-810b-4031-948c-aa38d6243522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.719790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb079174-810b-4031-948c-aa38d6243522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.720236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb079174-810b-4031-948c-aa38d6243522 admin admin] PATH_INFO: `/v3/projects/e6acc42e41034bf8ac680ba52125ff1b/users/0954dc239a654dc788d9272e97cef668/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.726986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb079174-810b-4031-948c-aa38d6243522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6acc42e41034bf8ac680ba52125ff1b, user_id=0954dc239a654dc788d9272e97cef668, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:45.729897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb079174-810b-4031-948c-aa38d6243522 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:45.746140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1086/2159] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:45 2022] PUT /identity/v3/projects/72d3b8e123be48b1813cb51bc105fa69/users/d19e3f0e8d0947858e711714d9f66461/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:45.750655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf42eb-c007-407c-a62f-64fc11d59b91 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.751326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf42eb-c007-407c-a62f-64fc11d59b91 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.751747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf42eb-c007-407c-a62f-64fc11d59b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.764915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1074/2160] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:45 2022] PUT /identity/v3/projects/e6acc42e41034bf8ac680ba52125ff1b/users/0954dc239a654dc788d9272e97cef668/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:45.773372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.773978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.774453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.831831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1bcf42eb-c007-407c-a62f-64fc11d59b91 None None] MFA Rules not processed for user `d19e3f0e8d0947858e711714d9f66461`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:45.833124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1bcf42eb-c007-407c-a62f-64fc11d59b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:45.865982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] MFA Rules not processed for user `0954dc239a654dc788d9272e97cef668`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:45.869046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:45.958637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1087/2161] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:45.960448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:45.960728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:45.961000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:45.995624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] MFA Rules not processed for user `0508dadbb3dc45b1bdf4d4fe83c4dac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:45.997033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:46.001908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1075/2162] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:46.007049 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.008628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:46.016185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:46.084913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1088/2163] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:46.087367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.091992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:46.094670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4737bf2-6e8d-4d84-abe7-1d87ef3b16ae None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.104094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.104953 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.105296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.105669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.109304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69cb40-ca8e-4178-8267-ef025dd2d215 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.114820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.115499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.115840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.116233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.122254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.124449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:46.130964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.132589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:46.141285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1076/2164] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:46.142732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.144109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:46.145963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1089/2165] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:46.287376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4cc17-bfac-4a7c-8681-bec8a9c1da8c service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.294471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.295437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.295844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.296297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.297178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.299503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:46.309403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.318625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970e2e-8223-4c65-8d34-3b66c9d357da service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.322930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.323656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.324034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.324404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.378584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1077/2166] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:46 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:46.382640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.418606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:46.490520 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.492019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:46.505720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5078-295d-47c4-917d-1151735f8fcd admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.514098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1090/2167] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:46.516656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.517375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.523991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.524309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.524985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.527792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:46.590725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1078/2168] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:46 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:46.593672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.616177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a72e1c-c4d4-4545-b7bb-ad9762161e1d service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.627961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.628847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.629829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.630353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.632711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.636233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:46.676960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1091/2169] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:46.678843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.720844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8143-2f18-4ff8-8d6b-a1c1b2f476bf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.730665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.731542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.731919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.732236 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] PATH_INFO: `/v3/projects/facb1c0f50aa4905b5fe5bf011dbfe05/users/51bbcba812554883a0f5517651747c4b/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.777520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=facb1c0f50aa4905b5fe5bf011dbfe05, user_id=51bbcba812554883a0f5517651747c4b, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.804108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:46.827795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:46.844916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1079/2170] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:46 2022] PUT /identity/v3/projects/facb1c0f50aa4905b5fe5bf011dbfe05/users/51bbcba812554883a0f5517651747c4b/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:46.846782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:46.865994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b54149-6f07-48fb-a7f1-959fbbf2b450 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:46.980647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:46.980979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:46.981337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:46.981677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:46.982438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:46.984356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:47.012518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:47.036389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1092/2171] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:47.037343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:47.042755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73196-47e9-4d14-97ae-a3840eb01f9f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:47.047947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:47.048873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:47.049261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:47.049642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] PATH_INFO: `/v3/users/6b03c738a3a94dbf97e93c644a8b3567` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:47.051860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b03c738a3a94dbf97e93c644a8b3567)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:47.053957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:47.057818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdad81-6134-4fe5-b8d5-763ce2aa1a6a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:47.071987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc646a54-5b88-4918-a809-ed52669a4b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:47.072798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc646a54-5b88-4918-a809-ed52669a4b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:47.073177 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc646a54-5b88-4918-a809-ed52669a4b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:47.074081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc646a54-5b88-4918-a809-ed52669a4b86 admin admin] PATH_INFO: `/v3/projects/facb1c0f50aa4905b5fe5bf011dbfe05/users/51bbcba812554883a0f5517651747c4b/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:47.076277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc646a54-5b88-4918-a809-ed52669a4b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facb1c0f50aa4905b5fe5bf011dbfe05, user_id=51bbcba812554883a0f5517651747c4b, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:47.079482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc646a54-5b88-4918-a809-ed52669a4b86 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:47.097802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1093/2172] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:47 2022] PUT /identity/v3/projects/facb1c0f50aa4905b5fe5bf011dbfe05/users/51bbcba812554883a0f5517651747c4b/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:47.165212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b03c738a3a94dbf97e93c644a8b3567'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:47.166593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b03c738a3a94dbf97e93c644a8b3567'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:47.167801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b03c738a3a94dbf97e93c644a8b3567'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:47.181474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b03c738a3a94dbf97e93c644a8b3567'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:47.193971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b03c738a3a94dbf97e93c644a8b3567'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:47.245918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1080/2173] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:47 2022] DELETE /identity/v3/users/6b03c738a3a94dbf97e93c644a8b3567 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:47.250448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:47.250738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:47.251041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:47.273186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:47.274703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:47.367120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1094/2174] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:47.380145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:47.381715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:47.457682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868da55-31e5-4bb1-817c-e1e844e26e0d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:47.461879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:47.462532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:47.462813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:47.463120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:47.475920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:47.477225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:47.505600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1081/2175] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:48.076008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:48.077561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:48.110747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192609b0-e03a-46da-9850-2a02893a4206 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:48.120231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:48.121884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:48.122386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:48.123032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] PATH_INFO: `/v3/projects/5a667a3c96a24a028db7a7d77bfe0fa0` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:48.125307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a667a3c96a24a028db7a7d77bfe0fa0)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:48.130771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:48.270341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:48.276148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a667a3c96a24a028db7a7d77bfe0fa0', 'request_id': 'req-2e2bc39f-347e-4f18-9761-10cd6cc71df8'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.286140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a667a3c96a24a028db7a7d77bfe0fa0', 'request_id': 'req-2e2bc39f-347e-4f18-9761-10cd6cc71df8'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.296457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a667a3c96a24a028db7a7d77bfe0fa0', 'request_id': 'req-2e2bc39f-347e-4f18-9761-10cd6cc71df8'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.312979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] The token cache is being invalidate because project 5a667a3c96a24a028db7a7d77bfe0fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:48.313752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.315411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.318679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1095/2176] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:48 2022] DELETE /identity/v3/projects/5a667a3c96a24a028db7a7d77bfe0fa0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:48.331942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:48.351008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea05936-ba83-4b09-9e42-ae8a555e6a7c service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:48.448940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:48.450261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:48.450627 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:48.450973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] PATH_INFO: `/v3/users/d19e3f0e8d0947858e711714d9f66461` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:48.452708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19e3f0e8d0947858e711714d9f66461)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:48.454885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:48.474850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:48.541567 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19e3f0e8d0947858e711714d9f66461'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.542401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19e3f0e8d0947858e711714d9f66461'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.543081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19e3f0e8d0947858e711714d9f66461'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.553474 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19e3f0e8d0947858e711714d9f66461'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.566894 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1121322c-bca9-4985-97e8-c5b34e42f027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19e3f0e8d0947858e711714d9f66461'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:48.604171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1082/2177] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:48 2022] DELETE /identity/v3/users/d19e3f0e8d0947858e711714d9f66461 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:49.224430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:49.227047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:49.250888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bc39f-347e-4f18-9761-10cd6cc71df8 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:49.426644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:49.428921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:49.428921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:49.428921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] PATH_INFO: `/v3/projects/72d3b8e123be48b1813cb51bc105fa69` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:49.430414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d3b8e123be48b1813cb51bc105fa69)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:49.447058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:49.601750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d3b8e123be48b1813cb51bc105fa69', 'request_id': 'req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.611117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d3b8e123be48b1813cb51bc105fa69', 'request_id': 'req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.622551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d3b8e123be48b1813cb51bc105fa69', 'request_id': 'req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.637868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] The token cache is being invalidate because project 72d3b8e123be48b1813cb51bc105fa69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:49.638327 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.639117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.641016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1096/2178] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:49 2022] DELETE /identity/v3/projects/72d3b8e123be48b1813cb51bc105fa69 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:49.645948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b4a5a-2839-4a81-b51c-e7faaae7563c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:49.646494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b4a5a-2839-4a81-b51c-e7faaae7563c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:49.646586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b4a5a-2839-4a81-b51c-e7faaae7563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:49.689934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-389b4a5a-2839-4a81-b51c-e7faaae7563c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:49.691890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-389b4a5a-2839-4a81-b51c-e7faaae7563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:49.798859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:49.802749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:49.810972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1083/2179] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:49.833693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c00a1-8719-447d-8e90-088334c86f20 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:49.833693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c00a1-8719-447d-8e90-088334c86f20 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:49.833693 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c00a1-8719-447d-8e90-088334c86f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:49.850822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82bdd9-ff01-4bab-b687-8afca25e3d1b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:49.858358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:49.859213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:49.859610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:49.859989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] PATH_INFO: `/v3/users/6bd8297e21774a8084f9168fae51ef04` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:49.861317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bd8297e21774a8084f9168fae51ef04)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:49.864119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:49.869831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-653c00a1-8719-447d-8e90-088334c86f20 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:49.871383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-653c00a1-8719-447d-8e90-088334c86f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:49.880570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1084/2180] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:49.884402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c00a1-8719-447d-8e90-088334c86f20 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:49.899713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c00a1-8719-447d-8e90-088334c86f20 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:49.909108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:49.910621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:49.910910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:49.911214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:49.913111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:49.913402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:49.916112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:49.935807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1085/2181] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:29:49.937353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:49.954195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8f82-2adb-4233-9ef8-35d781f04831 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:49.960990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:49.961617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:49.961893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:49.962202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:49.962893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:49.964879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:49.971494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bd8297e21774a8084f9168fae51ef04'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.985531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bd8297e21774a8084f9168fae51ef04'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.989450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bd8297e21774a8084f9168fae51ef04'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:49.995795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:50.008135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bd8297e21774a8084f9168fae51ef04'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:50.009817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e5a3bdf4-c180-4566-8103-98bf29dfd7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bd8297e21774a8084f9168fae51ef04'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:50.012179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1086/2182] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:49 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:50.016215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:50.018412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:50.042392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1097/2183] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:49 2022] DELETE /identity/v3/users/6bd8297e21774a8084f9168fae51ef04 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:50.047566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:50.047566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:50.047845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:50.092389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:50.101596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:50.149294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:50.187974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627953d-b5ff-4bc1-947e-af2ed4e68073 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:50.262131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1098/2184] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:50.275862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:50.278242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:50.295332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:50.296133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:50.296482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:50.296807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:50.297510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:50.301258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:50.335010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1087/2185] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:50 2022] POST /identity/v3/users => generated 292 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:50.350773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:50.364411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbed4-1bb1-4f17-93cf-d76902f37693 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:50.374290 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:50.375908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:50.377565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:50.377932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:50.384243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:50.386481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:50.406035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1088/2186] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:50.409650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:50.428698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3f121-36b8-4955-9ac6-a877afa85931 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:50.438220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:50.439609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:50.440451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:50.440926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:50.443124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:50.445920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:50.446225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22e5ab-5f90-4269-9a3c-df1dc788c81c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:50.453684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf8326-23dc-4158-973e-2a3e35cfde06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:50.454364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf8326-23dc-4158-973e-2a3e35cfde06 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:50.454647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf8326-23dc-4158-973e-2a3e35cfde06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:50.454920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf8326-23dc-4158-973e-2a3e35cfde06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:50.463884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1089/2187] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:50.468399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:50.474655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf8326-23dc-4158-973e-2a3e35cfde06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:50.481180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf8326-23dc-4158-973e-2a3e35cfde06 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:50.493701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb82f41-9f39-4edd-85fc-aee0031f0901 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:50.505285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1099/2188] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:50.513955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:50.514689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:50.514884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:50.515137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] PATH_INFO: `/v3/projects/b77cc3a2db7642bca1b001cd200e1244/users/83afcbfbde804c4cb4a0cc986df7ee56/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:50.532639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77cc3a2db7642bca1b001cd200e1244, user_id=83afcbfbde804c4cb4a0cc986df7ee56, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:50.536149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:50.552677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1090/2189] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:50 2022] PUT /identity/v3/projects/b77cc3a2db7642bca1b001cd200e1244/users/83afcbfbde804c4cb4a0cc986df7ee56/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:50.564197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a512-652e-4f73-8b70-4a7aec75778f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:50.564734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a512-652e-4f73-8b70-4a7aec75778f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:50.565116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60a512-652e-4f73-8b70-4a7aec75778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:50.608808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-7f60a512-652e-4f73-8b70-4a7aec75778f None None] MFA Rules not processed for user `83afcbfbde804c4cb4a0cc986df7ee56`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:50.612602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7f60a512-652e-4f73-8b70-4a7aec75778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:50.884472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1100/2190] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:50.891210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.060205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9014a-4c09-4dc8-ae3b-f4ccdd8a9c2d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:51.065366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:51.066079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:51.066571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:51.066926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:51.067638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:51.072946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:51.131294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60a512-652e-4f73-8b70-4a7aec75778f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.140762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1091/2191] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:50 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:51.156020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60a512-652e-4f73-8b70-4a7aec75778f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:51.167149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:51.350428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:51.353418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:51.353847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:51.354231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:51.354928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:51.356929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:51.391316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.393181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:51.419715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c41a-c996-4284-96ba-4301af784394 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:51.432813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:51.433035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1101/2192] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:51 2022] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:51.434016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:51.434211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.435537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:51.435970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] PATH_INFO: `/v3/projects/2b7573ecaf6f4782a7c9fbfb7128bbd1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:51.438351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7573ecaf6f4782a7c9fbfb7128bbd1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:51.442197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:51.463207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7930b85-47ec-40b9-a6f1-c9f1a81298ec admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:51.468169 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:51.469066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:51.469417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:51.469760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:51.470524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:51.474145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:51.485879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:51.499355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1102/2193] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:51.503501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.521311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470757e7-cc4a-4c71-b21e-820e806f9891 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:51.559636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7573ecaf6f4782a7c9fbfb7128bbd1', 'request_id': 'req-49917c20-8f70-40d7-85b6-5f36863849ed'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:51.573095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7573ecaf6f4782a7c9fbfb7128bbd1', 'request_id': 'req-49917c20-8f70-40d7-85b6-5f36863849ed'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:51.587442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7573ecaf6f4782a7c9fbfb7128bbd1', 'request_id': 'req-49917c20-8f70-40d7-85b6-5f36863849ed'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:51.612136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] The token cache is being invalidate because project 2b7573ecaf6f4782a7c9fbfb7128bbd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:51.612442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:51.614887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:51.617352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1092/2194] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:51 2022] DELETE /identity/v3/projects/2b7573ecaf6f4782a7c9fbfb7128bbd1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:51.621861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.624974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:51.643092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:51.643760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:51.644570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:51.644867 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] PATH_INFO: `/v3/projects/bb405146eb5a4ffebffcea897af5f23f/users/7ca666b03209440f9a52a319ed48944b/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:51.668872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb405146eb5a4ffebffcea897af5f23f, user_id=7ca666b03209440f9a52a319ed48944b, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:51.679416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:51.707696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1103/2195] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:51 2022] PUT /identity/v3/projects/bb405146eb5a4ffebffcea897af5f23f/users/7ca666b03209440f9a52a319ed48944b/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:51.708893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.712802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:51.744408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49917c20-8f70-40d7-85b6-5f36863849ed admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:51.888756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:51.889340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:51.889620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:51.889893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] PATH_INFO: `/v3/users/0954dc239a654dc788d9272e97cef668` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:51.891734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba248571-994a-44cd-b8d2-c96d1ee7cfd7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:51.893927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0954dc239a654dc788d9272e97cef668)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:51.897076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:51.926433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:51.926891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:51.927171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:51.927438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:51.928241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:51.930467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:51.951477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1104/2196] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:51.954558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:51.963623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:51.989439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a4378-7202-4d10-841d-d56551e44c5f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:52.001307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592112ce-8718-4790-8c7c-43cc0e10da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:52.002141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592112ce-8718-4790-8c7c-43cc0e10da79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:52.002408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592112ce-8718-4790-8c7c-43cc0e10da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:52.002858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592112ce-8718-4790-8c7c-43cc0e10da79 admin admin] PATH_INFO: `/v3/projects/bb405146eb5a4ffebffcea897af5f23f/users/7ca666b03209440f9a52a319ed48944b/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:52.007684 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592112ce-8718-4790-8c7c-43cc0e10da79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb405146eb5a4ffebffcea897af5f23f, user_id=7ca666b03209440f9a52a319ed48944b, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:52.008642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0954dc239a654dc788d9272e97cef668'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:52.009689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0954dc239a654dc788d9272e97cef668'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:52.010674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0954dc239a654dc788d9272e97cef668'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:52.011146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592112ce-8718-4790-8c7c-43cc0e10da79 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:52.032725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1105/2197] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:51 2022] PUT /identity/v3/projects/bb405146eb5a4ffebffcea897af5f23f/users/7ca666b03209440f9a52a319ed48944b/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:52.036893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0954dc239a654dc788d9272e97cef668'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:52.041717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:52.049745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce03a4-4d1b-4989-ac4c-1c0c40a7ab40 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:52.050932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce03a4-4d1b-4989-ac4c-1c0c40a7ab40 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:52.065371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0954dc239a654dc788d9272e97cef668'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:52.065544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce03a4-4d1b-4989-ac4c-1c0c40a7ab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:52.102149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1093/2198] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:51 2022] DELETE /identity/v3/users/0954dc239a654dc788d9272e97cef668 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:52.118490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-01ce03a4-4d1b-4989-ac4c-1c0c40a7ab40 None None] MFA Rules not processed for user `7ca666b03209440f9a52a319ed48944b`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:52.123637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-01ce03a4-4d1b-4989-ac4c-1c0c40a7ab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:52.278681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1106/2199] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:52.291497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:52.293127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:52.419262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad175db-6f1a-4c26-9717-75393e8b6ef4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:52.430189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:52.430816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:52.431095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:52.431367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:52.446428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:52.448714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:52.478626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:52.480714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:52.485746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:52.503255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1094/2200] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:52.542713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:52.546644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:52.621080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:52.625789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:52.667148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5468b-2fca-4ce4-a70e-d432868cc792 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:52.675705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:52.677905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:52.680119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:52.681288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:52.687598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:52.710326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1107/2201] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:52.773412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:52.775191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:52.838593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:52.840611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:52.853101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1095/2202] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:52.888928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:52.891536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:52.916689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45816147-1212-4bcb-a6b8-7f5a7884f8ff None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:52.931507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985b3ef-e7fa-4ab3-9715-f5965b0b7aa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:52.933564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985b3ef-e7fa-4ab3-9715-f5965b0b7aa1 service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:52.935886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985b3ef-e7fa-4ab3-9715-f5965b0b7aa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:52.936350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985b3ef-e7fa-4ab3-9715-f5965b0b7aa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:52.969412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985b3ef-e7fa-4ab3-9715-f5965b0b7aa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:52.971661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985b3ef-e7fa-4ab3-9715-f5965b0b7aa1 service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:53.008293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1108/2203] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:29:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:53.115112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b068a0-3a6e-4043-ae35-3a158d64d743 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:53.144808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:53.145431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:53.145701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:53.145967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] PATH_INFO: `/v3/projects/e6acc42e41034bf8ac680ba52125ff1b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:53.155020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6acc42e41034bf8ac680ba52125ff1b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:53.160731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:53.226907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:53.308275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6acc42e41034bf8ac680ba52125ff1b', 'request_id': 'req-5a6ab111-e150-43e7-ade3-1980b081f098'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.323518 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6acc42e41034bf8ac680ba52125ff1b', 'request_id': 'req-5a6ab111-e150-43e7-ade3-1980b081f098'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.334530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6acc42e41034bf8ac680ba52125ff1b', 'request_id': 'req-5a6ab111-e150-43e7-ade3-1980b081f098'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.369695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] The token cache is being invalidate because project e6acc42e41034bf8ac680ba52125ff1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:53.369990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.370722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.374318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1096/2204] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:52 2022] DELETE /identity/v3/projects/e6acc42e41034bf8ac680ba52125ff1b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:53.377320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213ee7b-ddf9-4ac7-8b08-767296611931 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:53.377785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213ee7b-ddf9-4ac7-8b08-767296611931 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:53.378272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213ee7b-ddf9-4ac7-8b08-767296611931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:53.421381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d213ee7b-ddf9-4ac7-8b08-767296611931 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:53.426245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d213ee7b-ddf9-4ac7-8b08-767296611931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:53.438122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:53.496947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:53.498698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:53.557588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1109/2205] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:53.567026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6bce-7d39-4944-b0cc-b38ee7f7d5e4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:53.568060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6bce-7d39-4944-b0cc-b38ee7f7d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:53.568543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b6bce-7d39-4944-b0cc-b38ee7f7d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:53.601815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-7a6b6bce-7d39-4944-b0cc-b38ee7f7d5e4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:53.603542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7a6b6bce-7d39-4944-b0cc-b38ee7f7d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:53.630876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1110/2206] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:53.631482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab111-e150-43e7-ade3-1980b081f098 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:53.633715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b6bce-7d39-4944-b0cc-b38ee7f7d5e4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:53.640696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:53.641708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:53.643003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:53.643470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] PATH_INFO: `/v3/users/83afcbfbde804c4cb4a0cc986df7ee56` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:53.646150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83afcbfbde804c4cb4a0cc986df7ee56)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:53.647197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b6bce-7d39-4944-b0cc-b38ee7f7d5e4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:53.648685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:53.652964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:53.654159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:53.654910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:53.654910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:53.656116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:53.656682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:53.660186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:53.689934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1111/2207] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:53.691536 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:53.703375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e9c18-38b9-4637-a11e-e66be880762c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:53.712123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:53.712861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:53.713166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:53.713810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:53.714572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:53.718267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:53.760573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83afcbfbde804c4cb4a0cc986df7ee56'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.761498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83afcbfbde804c4cb4a0cc986df7ee56'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.762162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83afcbfbde804c4cb4a0cc986df7ee56'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.768005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1112/2208] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:53 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:53.774364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:53.776492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:53.783714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83afcbfbde804c4cb4a0cc986df7ee56'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.803626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-80353a41-d78e-4ea7-932e-a2c7388ee824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83afcbfbde804c4cb4a0cc986df7ee56'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:53.848247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1097/2209] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:53 2022] DELETE /identity/v3/users/83afcbfbde804c4cb4a0cc986df7ee56 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:53.864165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:53.864593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:53.865649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:53.877160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfa22c-7ef4-460a-996b-58427405082b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:53.926121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:53.928713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:53.976384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:53.998356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:54.000563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.000845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.001117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.004870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:54.010119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:54.058932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1113/2210] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:53 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:54.068030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.069171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1098/2211] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:54.079654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.081959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:54.089265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d45ca-8f41-46f7-b214-34746765bc54 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:54.101008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:54.102173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.102173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.102372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.103516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:54.105030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:54.107572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:54.121747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1114/2212] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:54.122642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.136395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99cb9-3836-4dd5-865d-96cac542a31b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:54.150645 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:54.152200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.152475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.152747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.153405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:54.158609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:54.180061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d73b7f-cbca-4301-adc3-166571ba0b88 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:54.184377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf66ac-d0e2-4034-b18b-8b33fde57c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:54.184999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf66ac-d0e2-4034-b18b-8b33fde57c45 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.185279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf66ac-d0e2-4034-b18b-8b33fde57c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.185552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf66ac-d0e2-4034-b18b-8b33fde57c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.196995 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1115/2213] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:54.199703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf66ac-d0e2-4034-b18b-8b33fde57c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:54.200936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.202083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf66ac-d0e2-4034-b18b-8b33fde57c45 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:54.214331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f654c-80fa-4f73-93d8-aa0ad1b8a85f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:54.214898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1099/2214] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:54.220176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef914c2-6d95-4d95-b5b2-f8ff1c0022f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:54.221157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef914c2-6d95-4d95-b5b2-f8ff1c0022f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.221549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef914c2-6d95-4d95-b5b2-f8ff1c0022f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.222560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef914c2-6d95-4d95-b5b2-f8ff1c0022f9 admin admin] PATH_INFO: `/v3/projects/e1b496e7f0e142e5bdeffe76a512ee3f/users/83c6c7cdfad0497390abd31fd0c27a36/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.242522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef914c2-6d95-4d95-b5b2-f8ff1c0022f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b496e7f0e142e5bdeffe76a512ee3f, user_id=83c6c7cdfad0497390abd31fd0c27a36, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:54.246425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef914c2-6d95-4d95-b5b2-f8ff1c0022f9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:54.265553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1116/2215] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:54 2022] PUT /identity/v3/projects/e1b496e7f0e142e5bdeffe76a512ee3f/users/83c6c7cdfad0497390abd31fd0c27a36/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:54.278300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6628ae-f206-40a1-9fff-29a881ec1b4e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.278428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.278663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.278918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6628ae-f206-40a1-9fff-29a881ec1b4e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.279056 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.279472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6628ae-f206-40a1-9fff-29a881ec1b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.324140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:54.330915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:54.331651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3e6628ae-f206-40a1-9fff-29a881ec1b4e None None] MFA Rules not processed for user `83c6c7cdfad0497390abd31fd0c27a36`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:54.334296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3e6628ae-f206-40a1-9fff-29a881ec1b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:54.446191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1100/2216] 10.222.0.18 () {58 vars in 967 bytes} [Fri Sep 30 19:29:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:54.464443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.466865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:54.505660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1117/2217] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:54.513603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6628ae-f206-40a1-9fff-29a881ec1b4e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.626402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87749f69-9920-4924-9b64-5ee11870dbe2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:54.642644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:54.643270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.643542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.644353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.654740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6628ae-f206-40a1-9fff-29a881ec1b4e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:54.655392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:54.656879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:54.665001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:54.665937 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:54.666075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:54.666359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:54.667558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:54.670118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:54.674901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1101/2218] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 19:29:54.800651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1118/2219] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:54 2022] POST /identity/v3/projects => generated 377 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:54.804270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.813362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:54.819489 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a667e-ef03-4811-8d96-a2967b86988e service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:54.907429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:54.910615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.000624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.001533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.002015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.002526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:55.004242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.005235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:55.008770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:55.032076 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348594b9-bc5b-4ae5-b369-676fd3a9f77c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:55.041804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.044008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.044450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.045229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.047185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1102/2220] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:54 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:55.052773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.059192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:55.062685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.085430 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88131f-4433-4981-9e51-90666315e195 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:55.092162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.092723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.093008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.093287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] PATH_INFO: `/v3/projects/b77cc3a2db7642bca1b001cd200e1244` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.094465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77cc3a2db7642bca1b001cd200e1244)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:55.097749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:55.160438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:55.162302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:55.178918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1119/2221] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:55.179788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:55.184503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77cc3a2db7642bca1b001cd200e1244', 'request_id': 'req-974b62f3-05da-4b3f-aa08-476d33e34952'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.209789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d060b-a21f-4e50-b0c2-79aac5d1bef6 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:55.217532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77cc3a2db7642bca1b001cd200e1244', 'request_id': 'req-974b62f3-05da-4b3f-aa08-476d33e34952'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.253156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77cc3a2db7642bca1b001cd200e1244', 'request_id': 'req-974b62f3-05da-4b3f-aa08-476d33e34952'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.280162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] The token cache is being invalidate because project b77cc3a2db7642bca1b001cd200e1244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:55.280352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.281279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-974b62f3-05da-4b3f-aa08-476d33e34952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.288671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1103/2222] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:55 2022] DELETE /identity/v3/projects/b77cc3a2db7642bca1b001cd200e1244 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:55.319465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.321769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.322383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.350045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.350952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.351063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.351330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.352128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:55.353942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:55.357498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:55.360262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.386396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1120/2223] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:55.387325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:55.389233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.405526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522e346-59b0-43ad-b974-92d2afa6b2a3 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:55.422928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.423862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.424150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.424488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] PATH_INFO: `/v3/users/7ca666b03209440f9a52a319ed48944b` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.427140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca666b03209440f9a52a319ed48944b)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:55.433765 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:55.474580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1104/2224] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:29:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:55.476181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:55.477824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.520702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357705a-03f0-4d65-8583-f62a7d39e39a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:55.531917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.533128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.533128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.533128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.533698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:55.536258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:55.551435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1105/2225] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:55.551435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:55.553803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.556487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca666b03209440f9a52a319ed48944b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.570699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca666b03209440f9a52a319ed48944b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.571350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca666b03209440f9a52a319ed48944b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.575062 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:55.586813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca666b03209440f9a52a319ed48944b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.588349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca666b03209440f9a52a319ed48944b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:55.614288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:55.629197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1121/2226] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:29:55 2022] DELETE /identity/v3/users/7ca666b03209440f9a52a319ed48944b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:55.630407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:55.632153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.676084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e79b52-59a6-402c-9a06-326a5eb8828c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:55.731726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de09ec-5f43-473d-94e9-9fedcbafbb78 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:55.740111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8c221-04af-4c98-92e4-add465b656e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.741887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c221-04af-4c98-92e4-add465b656e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.742203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c221-04af-4c98-92e4-add465b656e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.743759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c221-04af-4c98-92e4-add465b656e3 admin admin] PATH_INFO: `/v3/projects/1a04939cae134d4989c6b42cd7b56cf7/users/d75fd81d09ac45ee97a2469f5a9e03b2/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.800983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8c221-04af-4c98-92e4-add465b656e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a04939cae134d4989c6b42cd7b56cf7, user_id=d75fd81d09ac45ee97a2469f5a9e03b2, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:55.800983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8c221-04af-4c98-92e4-add465b656e3 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:55.823809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:55.826780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.827259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.827717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.842164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1122/2227] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:55 2022] PUT /identity/v3/projects/1a04939cae134d4989c6b42cd7b56cf7/users/d75fd81d09ac45ee97a2469f5a9e03b2/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:55.842164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8031-6f27-4879-ac63-04278df39054 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:55.842164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8031-6f27-4879-ac63-04278df39054 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:55.842164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e8031-6f27-4879-ac63-04278df39054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:55.846178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:55.898155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c99e8031-6f27-4879-ac63-04278df39054 None None] MFA Rules not processed for user `51bbcba812554883a0f5517651747c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:55.902138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c99e8031-6f27-4879-ac63-04278df39054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.022466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:56.024487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:56.036597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1123/2228] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:56.037341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1106/2229] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:56.038272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.038561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.038911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.056128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:56.060969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.118042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] MFA Rules not processed for user `d75fd81d09ac45ee97a2469f5a9e03b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:56.119646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.180268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:56.201511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:56.228360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e51e7-4bd1-4094-8753-b7fa9e59491d service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:56.230680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1124/2230] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:56.234869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:56.238151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.357022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:56.357786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.358251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.358603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.360730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.374253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21754a-3605-4226-bd9f-4f7660fc42c3 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:56.384941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:56.385737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.386013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.386340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] PATH_INFO: `/v3/projects/bb405146eb5a4ffebffcea897af5f23f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.388414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb405146eb5a4ffebffcea897af5f23f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:56.391271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:56.451277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:56.454548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:56.475606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb405146eb5a4ffebffcea897af5f23f', 'request_id': 'req-56352566-5cea-442d-9cd5-fd2d435a1488'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:56.482492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1107/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:56.483812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:56.497486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac3b4-1d30-41d6-9ac1-19c229627c8e service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:56.499636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb405146eb5a4ffebffcea897af5f23f', 'request_id': 'req-56352566-5cea-442d-9cd5-fd2d435a1488'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:56.516753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb405146eb5a4ffebffcea897af5f23f', 'request_id': 'req-56352566-5cea-442d-9cd5-fd2d435a1488'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:56.532152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] The token cache is being invalidate because project bb405146eb5a4ffebffcea897af5f23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:29:56.532490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:56.533168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-56352566-5cea-442d-9cd5-fd2d435a1488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:29:56.535029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1125/2232] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:29:56 2022] DELETE /identity/v3/projects/bb405146eb5a4ffebffcea897af5f23f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:56.542734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612961-aa1b-4bb1-9ca0-0cafb6c819a4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.543386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612961-aa1b-4bb1-9ca0-0cafb6c819a4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.543650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84612961-aa1b-4bb1-9ca0-0cafb6c819a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.591038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04911-149d-485f-85fa-2acc6934b09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:56.591721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04911-149d-485f-85fa-2acc6934b09b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.591926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04911-149d-485f-85fa-2acc6934b09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.592338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04911-149d-485f-85fa-2acc6934b09b admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.593040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04911-149d-485f-85fa-2acc6934b09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:56.595326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04911-149d-485f-85fa-2acc6934b09b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:56.599733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-84612961-aa1b-4bb1-9ca0-0cafb6c819a4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:56.600877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-84612961-aa1b-4bb1-9ca0-0cafb6c819a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.609376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1126/2233] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:56.610644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.610928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.611201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.635225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:56.636727 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.657330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1108/2234] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:56 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:56.660090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.660090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.660090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.697242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:56.697434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.728543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:56.816188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1127/2235] 10.222.0.18 () {58 vars in 967 bytes} [Fri Sep 30 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:56.817140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:56.818415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.848992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f2c5-1bb2-4f33-864d-4eada2756e6f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:56.858478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1109/2236] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:29:56.859359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:56.862793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:56.863728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.864114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.864395 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.865186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:56.865296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:56.867763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:56.899301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1128/2237] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:56 2022] POST /identity/v3/users => generated 295 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:56.900264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:56.908769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:56.916187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fe88e-5cd3-4c70-b50c-26f684111423 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:56.931750 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:56.932125 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.932718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.933001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.933720 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:29:56.934031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:56.936354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:56.953888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1129/2238] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:29:56.955041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:56.970972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d275e-c1bc-4eb6-bbd1-a1d792a3264a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:56.980552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:56.981181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:56.981607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:56.981920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:56.982586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:56.984214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:56.997794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1130/2239] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:56.999036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.004104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837cd4e-4c08-49bd-810e-a0cd547afcb4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.011422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d730b93-c645-4d01-bb2b-34901c368a11 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.014797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.016501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.016827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.017557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.025465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.026737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.027282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.027654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.028559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.030670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.086160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1131/2240] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:29:56 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:57.088678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.124012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.126184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.137943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1110/2241] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:29:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:29:57.139207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.153736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e9e03-933e-4579-9712-26a39b35ee1f service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.212153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8f84d-3cf2-465b-bc34-0a8b784fd032 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.219825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.220644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.221143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.221372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] PATH_INFO: `/v3/projects/6b02d9a000ce49b5b6ceece9f22c4488/users/d716c4489bc744849269a05bfca39396/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.233552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:57.244074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.245317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.245671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.246173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.246951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.247788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b02d9a000ce49b5b6ceece9f22c4488, user_id=d716c4489bc744849269a05bfca39396, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.250237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.252364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.281400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1132/2242] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:57 2022] PUT /identity/v3/projects/6b02d9a000ce49b5b6ceece9f22c4488/users/d716c4489bc744849269a05bfca39396/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:57.285502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.286846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1111/2243] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:29:57 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:29:57.294615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.314411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4e251-234a-4aeb-b852-e570250049aa admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.441932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80347033-1b89-4f61-a526-de3ef3bb95fa admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.454078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.455102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.456906 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.457615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.458907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.460785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.471872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.472977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.473890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.474267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.475184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.478323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.492963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1133/2244] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:29:57.493375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1112/2245] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:57.493836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.495811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.507625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc23ae6-e132-4aa5-bc25-ea539d944277 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.512993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da8b3a-4b67-4276-959b-71c1cf7c1690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.513908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8b3a-4b67-4276-959b-71c1cf7c1690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.514249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8b3a-4b67-4276-959b-71c1cf7c1690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.514526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da8b3a-4b67-4276-959b-71c1cf7c1690 admin admin] PATH_INFO: `/v3/projects/6b02d9a000ce49b5b6ceece9f22c4488/users/d716c4489bc744849269a05bfca39396/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.516681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da8b3a-4b67-4276-959b-71c1cf7c1690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b02d9a000ce49b5b6ceece9f22c4488, user_id=d716c4489bc744849269a05bfca39396, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.520967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da8b3a-4b67-4276-959b-71c1cf7c1690 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.524191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca39f1-9452-416a-86b5-89a7f41b7a84 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.530475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.533006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.545133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1134/2246] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:57 2022] PUT /identity/v3/projects/6b02d9a000ce49b5b6ceece9f22c4488/users/d716c4489bc744849269a05bfca39396/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:29:57.546821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.546821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.546821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.546821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.551788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.552170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.552534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.562226 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1113/2247] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:29:57.567245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.582845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d465b62-1ac0-4445-a4d6-591aa381e863 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.616580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] MFA Rules not processed for user `d716c4489bc744849269a05bfca39396`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:57.617842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:57.629928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:57.694543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f44dd-d22a-44a3-920d-73cde917d343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.695409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f44dd-d22a-44a3-920d-73cde917d343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.695699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f44dd-d22a-44a3-920d-73cde917d343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.696827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f44dd-d22a-44a3-920d-73cde917d343 admin admin] PATH_INFO: `/v3/projects/869c8a45542445e0a8f232d190d5e7fe/users/138c7dc304c3412d818e857c98d88973/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.716178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f44dd-d22a-44a3-920d-73cde917d343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869c8a45542445e0a8f232d190d5e7fe, user_id=138c7dc304c3412d818e857c98d88973, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:57.723703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f44dd-d22a-44a3-920d-73cde917d343 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:57.740954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1114/2248] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:29:57 2022] PUT /identity/v3/projects/869c8a45542445e0a8f232d190d5e7fe/users/138c7dc304c3412d818e857c98d88973/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:29:57.753189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.753189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.753458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:57.791202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1135/2249] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:57.803877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.805341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] MFA Rules not processed for user `138c7dc304c3412d818e857c98d88973`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:57.805472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:57.806892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:57.887046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe20f3-c4e8-443d-b6ae-68a387822188 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:57.908445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:57.959641 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1115/2250] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:29:57.975983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:57.977717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:57.995250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:57.996147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:57.996573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:57.996992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:58.144676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:58.146462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:58.147664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3e6a9-652e-465f-94ca-62e09dda83d8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:58.154116 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df5eed-ead4-4f2c-a42e-9a78754fc43a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5190ae783a4c89b51797729aaaa6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:58.155534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5eed-ead4-4f2c-a42e-9a78754fc43a service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:58.156256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5eed-ead4-4f2c-a42e-9a78754fc43a service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:58.156764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5eed-ead4-4f2c-a42e-9a78754fc43a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:58.162843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1136/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:58.187796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df5eed-ead4-4f2c-a42e-9a78754fc43a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:58.189475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df5eed-ead4-4f2c-a42e-9a78754fc43a service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:58.206421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1116/2252] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:29:58.225128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:29:58.234954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a453f-affb-462c-bc78-c2cdec1915ea service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:29:58.243466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:29:58.244725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:58.245225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:58.249505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:58.251813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:58.264298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:29:58.299120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdec01-81b6-4d95-bd0b-31acfe306509 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:29:58.299622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdec01-81b6-4d95-bd0b-31acfe306509 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:29:58.300382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdec01-81b6-4d95-bd0b-31acfe306509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:29:58.329650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e8cdec01-81b6-4d95-bd0b-31acfe306509 None None] MFA Rules not processed for user `0508dadbb3dc45b1bdf4d4fe83c4dac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:29:58.331672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e8cdec01-81b6-4d95-bd0b-31acfe306509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:29:58.352772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:29:58.359056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:29:58.377590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1137/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:29:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:29:58.444614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1117/2254] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:29:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:30:01.095825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:01.098203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:01.199083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da1ee6-419a-4236-980b-7114522a3f0a service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:01.202323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:01.203391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:01.203391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:01.204240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] PATH_INFO: `/v3/users/4d2f36ce3d8643f39771e1f1bc6df096` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:01.205010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2f36ce3d8643f39771e1f1bc6df096)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:01.209116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:01.295329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2f36ce3d8643f39771e1f1bc6df096'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.304916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2f36ce3d8643f39771e1f1bc6df096'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.306218 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2f36ce3d8643f39771e1f1bc6df096'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.313336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2f36ce3d8643f39771e1f1bc6df096'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.313984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2f36ce3d8643f39771e1f1bc6df096'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.333483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1138/2255] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:01 2022] DELETE /identity/v3/users/4d2f36ce3d8643f39771e1f1bc6df096 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:01.338102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:01.338603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:01.338700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:01.358158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:01.359353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:01.429620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1118/2256] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:01.439307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:01.440896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:01.478893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:01.509678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54574caa-6955-448d-b757-9e8bac8bd4e9 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:01.514455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:01.515351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:01.515751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:01.516110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:01.527242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:01.528670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:01.541253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1139/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:01.777451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:01.779320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:01.803253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37baaa-03f6-44c4-96fa-ed48d6cca959 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:01.808322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:01.808908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:01.809188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:01.809457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] PATH_INFO: `/v3/projects/8c3cca9902a7435e9a08147972c75c1f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:01.811331 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3cca9902a7435e9a08147972c75c1f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:01.814358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:01.825722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:01.866268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3cca9902a7435e9a08147972c75c1f', 'request_id': 'req-d9167c7f-3803-4d6d-8514-32d2295e8498'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.881563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3cca9902a7435e9a08147972c75c1f', 'request_id': 'req-d9167c7f-3803-4d6d-8514-32d2295e8498'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.889958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3cca9902a7435e9a08147972c75c1f', 'request_id': 'req-d9167c7f-3803-4d6d-8514-32d2295e8498'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.901146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] The token cache is being invalidate because project 8c3cca9902a7435e9a08147972c75c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:01.901426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.902091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d9167c7f-3803-4d6d-8514-32d2295e8498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:01.903574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1119/2258] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:01 2022] DELETE /identity/v3/projects/8c3cca9902a7435e9a08147972c75c1f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:02.417430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:02.419025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:02.434288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b58bf4-6037-452a-b225-dd78181cfb35 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:02.512297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:02.512933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:02.513216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:02.513490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] PATH_INFO: `/v3/users/83c6c7cdfad0497390abd31fd0c27a36` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:02.514629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c6c7cdfad0497390abd31fd0c27a36)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:02.516523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:02.572517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c6c7cdfad0497390abd31fd0c27a36'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:02.587661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c6c7cdfad0497390abd31fd0c27a36'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:02.588409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c6c7cdfad0497390abd31fd0c27a36'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:02.597618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c6c7cdfad0497390abd31fd0c27a36'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:02.598433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c6c7cdfad0497390abd31fd0c27a36'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:02.621003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1140/2259] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:02 2022] DELETE /identity/v3/users/83c6c7cdfad0497390abd31fd0c27a36 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:02.626689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:02.627467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:02.627467 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:02.656109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:02.656109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:02.738644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1120/2260] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:02.743050 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:02.744470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:02.825975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1368-2cdc-44c8-af26-b809d467b2eb admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:02.832726 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:02.834378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:02.834378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:02.834761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:02.849010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:02.853122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:02.855612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:02.869641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1141/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:03.281379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:03.282920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:03.296940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3501d5-10c6-42a7-98a0-1022acf50c3e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:03.302500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:03.303153 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:03.303438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:03.303715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] PATH_INFO: `/v3/projects/e1b496e7f0e142e5bdeffe76a512ee3f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:03.304974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b496e7f0e142e5bdeffe76a512ee3f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:03.306937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:03.359104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b496e7f0e142e5bdeffe76a512ee3f', 'request_id': 'req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.367853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b496e7f0e142e5bdeffe76a512ee3f', 'request_id': 'req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.374437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b496e7f0e142e5bdeffe76a512ee3f', 'request_id': 'req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.385565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] The token cache is being invalidate because project e1b496e7f0e142e5bdeffe76a512ee3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:03.385858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.386569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.388152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1121/2262] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:03 2022] DELETE /identity/v3/projects/e1b496e7f0e142e5bdeffe76a512ee3f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:03.392264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:03.403183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75139e54-ed51-4799-a91c-17a3d4855dad service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:03.462883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:03.463559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:03.463774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:03.464042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] PATH_INFO: `/v3/users/d75fd81d09ac45ee97a2469f5a9e03b2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:03.465212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75fd81d09ac45ee97a2469f5a9e03b2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:03.467326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:03.517826 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75fd81d09ac45ee97a2469f5a9e03b2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.525799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75fd81d09ac45ee97a2469f5a9e03b2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.526582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75fd81d09ac45ee97a2469f5a9e03b2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.543138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75fd81d09ac45ee97a2469f5a9e03b2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.543886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75fd81d09ac45ee97a2469f5a9e03b2'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.563642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1142/2263] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:03 2022] DELETE /identity/v3/users/d75fd81d09ac45ee97a2469f5a9e03b2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:03.860184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:03.861677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:03.880333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e25a3-7654-43fb-9e53-3a0c00b46cf2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:03.901205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:03.942503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:03.943124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:03.943399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:03.943665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] PATH_INFO: `/v3/projects/1a04939cae134d4989c6b42cd7b56cf7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:03.944760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a04939cae134d4989c6b42cd7b56cf7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:03.946691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:03.992243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a04939cae134d4989c6b42cd7b56cf7', 'request_id': 'req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:03.999946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a04939cae134d4989c6b42cd7b56cf7', 'request_id': 'req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.008463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a04939cae134d4989c6b42cd7b56cf7', 'request_id': 'req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.019851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] The token cache is being invalidate because project 1a04939cae134d4989c6b42cd7b56cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:04.020139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.020796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.022350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1122/2264] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:03 2022] DELETE /identity/v3/projects/1a04939cae134d4989c6b42cd7b56cf7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:04.026801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:04.028565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:04.042017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970e0ae-f49d-4299-9c77-a6c884f9d1b2 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:04.101201 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:04.101831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:04.102150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:04.102430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] PATH_INFO: `/v3/users/d716c4489bc744849269a05bfca39396` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:04.103555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d716c4489bc744849269a05bfca39396)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:04.105570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:04.124312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:04.163921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd716c4489bc744849269a05bfca39396'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.179777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd716c4489bc744849269a05bfca39396'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.180401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd716c4489bc744849269a05bfca39396'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.187802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd716c4489bc744849269a05bfca39396'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.188718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-38c76921-6a6f-41c9-80cb-161661c6cd37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd716c4489bc744849269a05bfca39396'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.209753 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1143/2265] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:04 2022] DELETE /identity/v3/users/d716c4489bc744849269a05bfca39396 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:04.748827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:04.749646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:04.765961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecaeeb-acb5-421f-9b80-7f52ac8ed1ae admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:04.838703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:04.839312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:04.839592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:04.839865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] PATH_INFO: `/v3/projects/6b02d9a000ce49b5b6ceece9f22c4488` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:04.840981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b02d9a000ce49b5b6ceece9f22c4488)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:04.842914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:04.900092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b02d9a000ce49b5b6ceece9f22c4488', 'request_id': 'req-4a768266-529d-410d-82e3-529197bcc926'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.903064 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:04.909148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b02d9a000ce49b5b6ceece9f22c4488', 'request_id': 'req-4a768266-529d-410d-82e3-529197bcc926'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.916541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b02d9a000ce49b5b6ceece9f22c4488', 'request_id': 'req-4a768266-529d-410d-82e3-529197bcc926'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.929790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] The token cache is being invalidate because project 6b02d9a000ce49b5b6ceece9f22c4488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:04.930207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.930951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4a768266-529d-410d-82e3-529197bcc926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:04.932701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1123/2266] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:04 2022] DELETE /identity/v3/projects/6b02d9a000ce49b5b6ceece9f22c4488 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:04.939237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf34b5-4199-4a3f-8d01-9518adeaf87d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:04.940336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf34b5-4199-4a3f-8d01-9518adeaf87d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:04.943931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf34b5-4199-4a3f-8d01-9518adeaf87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:04.964930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-99cf34b5-4199-4a3f-8d01-9518adeaf87d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:04.966272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-99cf34b5-4199-4a3f-8d01-9518adeaf87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:05.029415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1144/2267] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:05.038737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8575-48c6-40f2-9a04-078e88afa3a1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.039045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8575-48c6-40f2-9a04-078e88afa3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.039613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c8575-48c6-40f2-9a04-078e88afa3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.069054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-604c8575-48c6-40f2-9a04-078e88afa3a1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:05.070303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-604c8575-48c6-40f2-9a04-078e88afa3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:05.078333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1124/2268] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:05.083459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf34b5-4199-4a3f-8d01-9518adeaf87d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:05.093777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf34b5-4199-4a3f-8d01-9518adeaf87d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:05.098979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:05.099579 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.099858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.100127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.100772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:05.101070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:05.102716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:05.114675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1145/2269] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:30:05.118993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8575-48c6-40f2-9a04-078e88afa3a1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:05.128398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c8575-48c6-40f2-9a04-078e88afa3a1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:05.133053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:05.133654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.133932 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.134234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.134861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:05.136767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:05.164748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1125/2270] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:05 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:05.168903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:05.182311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12729159-4679-48c6-a22e-7359d252c498 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:05.238911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:05.239507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.239786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.240053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.240676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:05.242600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:05.267239 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1146/2271] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:05 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:30:05.268695 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:05.284703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78992cbd-aee9-43fa-951f-100d389a05ef admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:05.289427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:05.290031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.290338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.290611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.291266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:05.292884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:05.308730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1126/2272] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:05.312686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:05.323523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56621073-da09-4307-84a2-122c8dab22a4 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:05.328116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1aa4b-78cc-416b-825b-08b9a991227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:05.328698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1aa4b-78cc-416b-825b-08b9a991227c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.328976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1aa4b-78cc-416b-825b-08b9a991227c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.329245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1aa4b-78cc-416b-825b-08b9a991227c admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.329870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1aa4b-78cc-416b-825b-08b9a991227c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:05.331770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1aa4b-78cc-416b-825b-08b9a991227c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:05.336893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:05.342563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1147/2273] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:05.347296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:05.357018 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b511-459a-4556-ad5f-4db9d8986ec5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:05.361535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:05.362733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.363013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.363281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] PATH_INFO: `/v3/projects/26acd4e2dd23481287c7043b112d6cf7/users/15cd3b644c634d2e9f766dd1bd6a086e/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.379554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26acd4e2dd23481287c7043b112d6cf7, user_id=15cd3b644c634d2e9f766dd1bd6a086e, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:05.382258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:05.396845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1127/2274] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:05 2022] PUT /identity/v3/projects/26acd4e2dd23481287c7043b112d6cf7/users/15cd3b644c634d2e9f766dd1bd6a086e/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:30:05.408138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b532fe-362e-466e-a0a2-f05386f4f7b4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.408473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b532fe-362e-466e-a0a2-f05386f4f7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.408756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b532fe-362e-466e-a0a2-f05386f4f7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.437834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a9b532fe-362e-466e-a0a2-f05386f4f7b4 None None] MFA Rules not processed for user `15cd3b644c634d2e9f766dd1bd6a086e`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:05.438697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a9b532fe-362e-466e-a0a2-f05386f4f7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:05.505633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1148/2275] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:05.516854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:05.519256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:05.587025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9e4c-0c1b-44ef-b32c-8e24ff4d038b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:05.590598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488d59-7f03-4cdd-834e-63ce8de757f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:05.591205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488d59-7f03-4cdd-834e-63ce8de757f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:05.591478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488d59-7f03-4cdd-834e-63ce8de757f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:05.591742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488d59-7f03-4cdd-834e-63ce8de757f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:05.600067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb488d59-7f03-4cdd-834e-63ce8de757f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:05.601478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb488d59-7f03-4cdd-834e-63ce8de757f3 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:05.610114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1128/2276] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:11.161329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b532fe-362e-466e-a0a2-f05386f4f7b4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:11.232802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b532fe-362e-466e-a0a2-f05386f4f7b4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:11.248036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:11.248724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:11.249003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:11.249281 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] PATH_INFO: `/v3/users/15cd3b644c634d2e9f766dd1bd6a086e` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:11.251329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cd3b644c634d2e9f766dd1bd6a086e)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:11.254397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:11.330786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cd3b644c634d2e9f766dd1bd6a086e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:11.339842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cd3b644c634d2e9f766dd1bd6a086e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:11.341093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cd3b644c634d2e9f766dd1bd6a086e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:11.350393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cd3b644c634d2e9f766dd1bd6a086e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:11.351087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cd3b644c634d2e9f766dd1bd6a086e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:11.371899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1149/2277] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:11 2022] DELETE /identity/v3/users/15cd3b644c634d2e9f766dd1bd6a086e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:11.379112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:11.379665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:11.379665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:11.399820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:11.401025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:11.460916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1129/2278] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:11.470814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:11.472489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:11.483308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:11.533262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15342877-35fe-4f04-aab6-3b5fee0e15b5 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:11.537226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6ce91-60a5-47a2-9034-6ef3a50ed552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:11.537824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6ce91-60a5-47a2-9034-6ef3a50ed552 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:11.538131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6ce91-60a5-47a2-9034-6ef3a50ed552 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:11.538408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6ce91-60a5-47a2-9034-6ef3a50ed552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:11.547326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6ce91-60a5-47a2-9034-6ef3a50ed552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:11.550932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6ce91-60a5-47a2-9034-6ef3a50ed552 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:11.562110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1150/2279] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:11.903572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:11.905138 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:11.923002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6dbd0-7e94-49c8-a30a-b9c313447a4b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:11.928243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:11.928866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:11.929247 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:11.929407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] PATH_INFO: `/v3/projects/26acd4e2dd23481287c7043b112d6cf7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:11.930655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26acd4e2dd23481287c7043b112d6cf7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:11.932638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:11.950811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:11.987962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26acd4e2dd23481287c7043b112d6cf7', 'request_id': 'req-2b524a61-40c4-481b-abdf-e958abda1849'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:11.995522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26acd4e2dd23481287c7043b112d6cf7', 'request_id': 'req-2b524a61-40c4-481b-abdf-e958abda1849'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:12.001866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26acd4e2dd23481287c7043b112d6cf7', 'request_id': 'req-2b524a61-40c4-481b-abdf-e958abda1849'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:12.018792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] The token cache is being invalidate because project 26acd4e2dd23481287c7043b112d6cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:12.019132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:12.020076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2b524a61-40c4-481b-abdf-e958abda1849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:12.022368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1130/2280] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:11 2022] DELETE /identity/v3/projects/26acd4e2dd23481287c7043b112d6cf7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:12.028821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39952-48a7-424a-893e-428a8069fe86 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.029037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39952-48a7-424a-893e-428a8069fe86 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.029282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b39952-48a7-424a-893e-428a8069fe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.050006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-03b39952-48a7-424a-893e-428a8069fe86 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:12.051223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-03b39952-48a7-424a-893e-428a8069fe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:12.119853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1151/2281] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:30:12.128046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8e3d-5090-449f-91c2-490876b05fd4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.128362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8e3d-5090-449f-91c2-490876b05fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.128670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8e3d-5090-449f-91c2-490876b05fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.148166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6f3c8e3d-5090-449f-91c2-490876b05fd4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:12.149352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6f3c8e3d-5090-449f-91c2-490876b05fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:12.157079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1131/2282] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:12.161920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b39952-48a7-424a-893e-428a8069fe86 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:12.172191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b39952-48a7-424a-893e-428a8069fe86 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:12.177608 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:12.178261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.178600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.178881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.179530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:12.179861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:12.181525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:12.193795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1152/2283] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:30:12.198293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8e3d-5090-449f-91c2-490876b05fd4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:12.208115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8e3d-5090-449f-91c2-490876b05fd4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:12.213011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:12.213617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.213895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.214212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.214844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:12.216744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:12.247484 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1132/2284] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:12 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:12.251693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:12.261883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4092136-24f8-4efd-a0f2-aee9f96b202c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:12.323675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:12.324288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.324560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.324828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.325505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:12.327817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:12.358445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1153/2285] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:12 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:12.363670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:12.374246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751170e8-4598-4f08-b0a0-d16f3c51bd18 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:12.379275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:12.379902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.380181 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.380459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.381126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:12.382755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:12.396043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1133/2286] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:12.400749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:12.416741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599aa28e-1c6d-4b15-84d0-02c5d43be416 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:12.421345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34f993-1a16-4e12-ac11-8da92fc3e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:12.421938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f993-1a16-4e12-ac11-8da92fc3e2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.422243 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f993-1a16-4e12-ac11-8da92fc3e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.422514 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34f993-1a16-4e12-ac11-8da92fc3e2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.423341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f993-1a16-4e12-ac11-8da92fc3e2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:12.425911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34f993-1a16-4e12-ac11-8da92fc3e2c6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:12.441119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1154/2287] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:12.442285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:12.452038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650373d-5db8-4e33-9c3c-513d7e9cfbbf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:12.457127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:12.457776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.458086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.458357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] PATH_INFO: `/v3/projects/2e5533d8bda54f10aafa31eab1f430db/users/c6dbf29ce67d40debcd082dfff60aa81/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.474042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5533d8bda54f10aafa31eab1f430db, user_id=c6dbf29ce67d40debcd082dfff60aa81, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:12.476912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:12.496402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1134/2288] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:12 2022] PUT /identity/v3/projects/2e5533d8bda54f10aafa31eab1f430db/users/c6dbf29ce67d40debcd082dfff60aa81/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:12.507869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20d092-255b-4e36-a41c-9eed68763703 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.508154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20d092-255b-4e36-a41c-9eed68763703 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.508457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20d092-255b-4e36-a41c-9eed68763703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.542079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-af20d092-255b-4e36-a41c-9eed68763703 None None] MFA Rules not processed for user `c6dbf29ce67d40debcd082dfff60aa81`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:12.543309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-af20d092-255b-4e36-a41c-9eed68763703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:12.548522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:12.618670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1155/2289] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:12.631848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:12.633708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:12.697101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b7eb4-630a-4a49-bc21-c5d69e299668 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:12.700826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d812e-eedd-499e-9c84-50666c915add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:12.701428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d812e-eedd-499e-9c84-50666c915add service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:12.701723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d812e-eedd-499e-9c84-50666c915add service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:12.701987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d812e-eedd-499e-9c84-50666c915add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:12.711970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d812e-eedd-499e-9c84-50666c915add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:12.713392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d812e-eedd-499e-9c84-50666c915add service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:12.723152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1135/2290] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:18.631107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d046e-6a15-4fc1-b463-917cf125059e None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:18.631732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d046e-6a15-4fc1-b463-917cf125059e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:18.631993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d046e-6a15-4fc1-b463-917cf125059e None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:18.634241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1156/2291] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:30:18.664334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:18.664911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:18.664911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:18.698093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:18.699380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:18.776157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:18.816940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1136/2292] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:30:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:19.051858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d046e-6a15-4fc1-b463-917cf125059e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:19.060277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7c8d046e-6a15-4fc1-b463-917cf125059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:19.091457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d046e-6a15-4fc1-b463-917cf125059e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:19.104492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:19.104766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:19.104972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:19.105392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:19.115799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:19.117638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:19.128108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1157/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:19.335508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:19.337170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:19.460242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51706f64-b62f-4536-9eac-0152c64603e9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:19.471465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:19.472403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:19.477775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:19.478170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] PATH_INFO: `/v3/users/f021b1b7e5054a83b43490cbbcbec095` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:19.481738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f021b1b7e5054a83b43490cbbcbec095)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:19.483539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:19.544716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f021b1b7e5054a83b43490cbbcbec095'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.545623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f021b1b7e5054a83b43490cbbcbec095'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.546323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f021b1b7e5054a83b43490cbbcbec095'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.555418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f021b1b7e5054a83b43490cbbcbec095'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.564873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f021b1b7e5054a83b43490cbbcbec095'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.594261 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1137/2294] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:19 2022] DELETE /identity/v3/users/f021b1b7e5054a83b43490cbbcbec095 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:19.816944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:19.841831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10740e4-c845-4452-836e-2e770fdd6e25 service placement] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:19.918724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:19.919430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:19.919794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:19.920234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] PATH_INFO: `/v3/projects/e3dd64f217bc403599a0fde93a8d4088` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:19.921643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dd64f217bc403599a0fde93a8d4088)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:19.924445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:19.969373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dd64f217bc403599a0fde93a8d4088', 'request_id': 'req-768f5cac-a241-4ab1-a32f-40eb74dd9e14'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.976219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dd64f217bc403599a0fde93a8d4088', 'request_id': 'req-768f5cac-a241-4ab1-a32f-40eb74dd9e14'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.982942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dd64f217bc403599a0fde93a8d4088', 'request_id': 'req-768f5cac-a241-4ab1-a32f-40eb74dd9e14'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.993917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] The token cache is being invalidate because project e3dd64f217bc403599a0fde93a8d4088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:19.994230 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.994868 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:19.996356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1158/2295] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:19 2022] DELETE /identity/v3/projects/e3dd64f217bc403599a0fde93a8d4088 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:20.000359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:20.002265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:20.015301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb72006-8b6a-4135-b89e-a118ab787694 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:20.067712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:20.074382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:20.075367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:20.075748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:20.076090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] PATH_INFO: `/v3/users/89425e9fbebc470ca664c77f12bcabc1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:20.077447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89425e9fbebc470ca664c77f12bcabc1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:20.080278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:20.127566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89425e9fbebc470ca664c77f12bcabc1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.128212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89425e9fbebc470ca664c77f12bcabc1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.128834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89425e9fbebc470ca664c77f12bcabc1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.135768 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89425e9fbebc470ca664c77f12bcabc1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.144347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8102f908-fe6e-4a48-8b1e-be4ccd24bf59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89425e9fbebc470ca664c77f12bcabc1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.163557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1138/2296] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:19 2022] DELETE /identity/v3/users/89425e9fbebc470ca664c77f12bcabc1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:20.381737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:20.383327 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:20.400116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5cac-a241-4ab1-a32f-40eb74dd9e14 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:20.431204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:20.479792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:20.480426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:20.480705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:20.480977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] PATH_INFO: `/v3/projects/5e53d114b82a43009f2275276cde9196` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:20.482194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e53d114b82a43009f2275276cde9196)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:20.484103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:20.537046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e53d114b82a43009f2275276cde9196', 'request_id': 'req-5ef54a47-95d7-4e38-a5e1-d741753ef129'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.572967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e53d114b82a43009f2275276cde9196', 'request_id': 'req-5ef54a47-95d7-4e38-a5e1-d741753ef129'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.583450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e53d114b82a43009f2275276cde9196', 'request_id': 'req-5ef54a47-95d7-4e38-a5e1-d741753ef129'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.600719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] The token cache is being invalidate because project 5e53d114b82a43009f2275276cde9196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:20.601075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.601792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-5ef54a47-95d7-4e38-a5e1-d741753ef129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:20.603418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1159/2297] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:20 2022] DELETE /identity/v3/projects/5e53d114b82a43009f2275276cde9196 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:20.608428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c1a6-53d4-444b-82e9-c7f3c79cd53b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:20.608715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c1a6-53d4-444b-82e9-c7f3c79cd53b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:20.609052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6c1a6-53d4-444b-82e9-c7f3c79cd53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:20.632793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a2c6c1a6-53d4-444b-82e9-c7f3c79cd53b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:20.633983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a2c6c1a6-53d4-444b-82e9-c7f3c79cd53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:20.710093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1139/2298] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:20.713838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d0a1-f01b-4a4a-a881-2c62657ee153 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:20.714238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d0a1-f01b-4a4a-a881-2c62657ee153 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:20.714525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d0a1-f01b-4a4a-a881-2c62657ee153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:20.736743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-7df6d0a1-f01b-4a4a-a881-2c62657ee153 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:20.737954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7df6d0a1-f01b-4a4a-a881-2c62657ee153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:20.749418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1160/2299] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:20.754015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6c1a6-53d4-444b-82e9-c7f3c79cd53b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:20.768383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c6c1a6-53d4-444b-82e9-c7f3c79cd53b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:20.777273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:20.777273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:20.777273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:20.777273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:20.777607 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:20.777607 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:20.778777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:20.794871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1140/2300] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:30:20.800427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d0a1-f01b-4a4a-a881-2c62657ee153 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:20.809721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d0a1-f01b-4a4a-a881-2c62657ee153 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:20.814528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:20.815129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:20.815412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:20.815678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:20.816323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:20.818309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:20.863312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1161/2301] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:20 2022] POST /identity/v3/projects => generated 361 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:20.870104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:20.889090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea58e0-5fcd-40a6-bf1f-92590f6124f4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:20.959808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:20.960344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:20.960624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:20.960891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:20.961527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:20.964916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:20.976026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:20.991464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1141/2302] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:20 2022] POST /identity/v3/users => generated 281 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:20.995553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:21.010180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffa120-562e-4837-bad6-f83efa5e9588 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:21.022811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:21.023433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.023714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.023988 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.024636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:21.026303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:21.040063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1162/2303] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:21.041241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:21.052826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd319d1a-3058-408f-812c-66f6a8ef86ed admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:21.057883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfc074-17d8-4b5d-a021-1670e73c1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:21.058533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc074-17d8-4b5d-a021-1670e73c1218 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.058810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc074-17d8-4b5d-a021-1670e73c1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.059268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc074-17d8-4b5d-a021-1670e73c1218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.060132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfc074-17d8-4b5d-a021-1670e73c1218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:21.061757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfc074-17d8-4b5d-a021-1670e73c1218 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:21.074662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1142/2304] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:21.089931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:21.089931 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acca50a-693e-48d6-ba08-1a51f44edc9b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:21.094499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:21.095794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.096075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.096348 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] PATH_INFO: `/v3/projects/f87b3f76168f43b7ad654cc57778ddc2/users/85971da3b56044a3b5b13d1c974004fb/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.115259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87b3f76168f43b7ad654cc57778ddc2, user_id=85971da3b56044a3b5b13d1c974004fb, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:21.118118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:21.138098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1163/2305] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:21 2022] PUT /identity/v3/projects/f87b3f76168f43b7ad654cc57778ddc2/users/85971da3b56044a3b5b13d1c974004fb/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:21.149349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37ad32-2bdc-408e-809c-4618ad778107 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.149636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37ad32-2bdc-408e-809c-4618ad778107 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.149916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37ad32-2bdc-408e-809c-4618ad778107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.181990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fc37ad32-2bdc-408e-809c-4618ad778107 None None] MFA Rules not processed for user `85971da3b56044a3b5b13d1c974004fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:21.183306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fc37ad32-2bdc-408e-809c-4618ad778107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:21.264456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1143/2306] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:21.305571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:21.307300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:21.389506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8bfa4-16f9-4b62-9f25-513d777357ff admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:21.408586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25918f-8f20-4701-bac9-7906c964c298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:21.409699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25918f-8f20-4701-bac9-7906c964c298 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.410187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25918f-8f20-4701-bac9-7906c964c298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.410581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25918f-8f20-4701-bac9-7906c964c298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.417551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:21.427073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25918f-8f20-4701-bac9-7906c964c298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:21.429257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25918f-8f20-4701-bac9-7906c964c298 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:21.454531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1164/2307] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:21.474716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37ad32-2bdc-408e-809c-4618ad778107 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:21.560315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37ad32-2bdc-408e-809c-4618ad778107 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:21.565215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:21.566117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.566531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.566796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] PATH_INFO: `/v3/users/85971da3b56044a3b5b13d1c974004fb` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.568151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85971da3b56044a3b5b13d1c974004fb)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:21.571306 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:21.630560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85971da3b56044a3b5b13d1c974004fb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:21.631248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85971da3b56044a3b5b13d1c974004fb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:21.631858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85971da3b56044a3b5b13d1c974004fb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:21.639726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85971da3b56044a3b5b13d1c974004fb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:21.648941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85971da3b56044a3b5b13d1c974004fb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:21.662639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:21.681755 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1144/2308] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:21 2022] DELETE /identity/v3/users/85971da3b56044a3b5b13d1c974004fb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:21.686563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.687247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.687600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.722715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:21.723959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:21.802534 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1165/2309] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:21.814741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:21.816228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:21.883512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f86b10-e783-4231-b74c-67abfc82a546 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:21.887274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ceed18-700d-45c4-9e99-0ec8739ee2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:21.887950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceed18-700d-45c4-9e99-0ec8739ee2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:21.888223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceed18-700d-45c4-9e99-0ec8739ee2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:21.888501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ceed18-700d-45c4-9e99-0ec8739ee2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:21.899016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ceed18-700d-45c4-9e99-0ec8739ee2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:21.900454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ceed18-700d-45c4-9e99-0ec8739ee2b9 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:21.911208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1145/2310] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:30:22.212982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.214643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:22.228275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e5e38-77ac-4b1c-9849-2f53b6625df2 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:22.233207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:22.233923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.234254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.234557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] PATH_INFO: `/v3/projects/f87b3f76168f43b7ad654cc57778ddc2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.236401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87b3f76168f43b7ad654cc57778ddc2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:22.238386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:22.286038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87b3f76168f43b7ad654cc57778ddc2', 'request_id': 'req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:22.292179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87b3f76168f43b7ad654cc57778ddc2', 'request_id': 'req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:22.300961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87b3f76168f43b7ad654cc57778ddc2', 'request_id': 'req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:22.311769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] The token cache is being invalidate because project f87b3f76168f43b7ad654cc57778ddc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:22.312059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:22.312685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ed6b0e6c-26c8-4cae-9a72-6b22f79a8503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:22.314918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1166/2311] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:22 2022] DELETE /identity/v3/projects/f87b3f76168f43b7ad654cc57778ddc2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:22.319723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58778-77d5-4532-9f5b-b68da6a00d69 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.320180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58778-77d5-4532-9f5b-b68da6a00d69 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.320276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58778-77d5-4532-9f5b-b68da6a00d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.339727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-36c58778-77d5-4532-9f5b-b68da6a00d69 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:22.340923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-36c58778-77d5-4532-9f5b-b68da6a00d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:22.400388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1146/2312] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:22.409034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e2bac-aab9-4a9c-a5c6-6773e1c85a40 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.409319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e2bac-aab9-4a9c-a5c6-6773e1c85a40 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.409592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e2bac-aab9-4a9c-a5c6-6773e1c85a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.430307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2b0e2bac-aab9-4a9c-a5c6-6773e1c85a40 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:22.431542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2b0e2bac-aab9-4a9c-a5c6-6773e1c85a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:22.440249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1167/2313] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:22.444427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58778-77d5-4532-9f5b-b68da6a00d69 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.454268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58778-77d5-4532-9f5b-b68da6a00d69 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:22.458906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:22.459494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.459772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.460042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.460713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:22.461010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:22.462626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:22.473878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1147/2314] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:30:22.478178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e2bac-aab9-4a9c-a5c6-6773e1c85a40 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.487889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e2bac-aab9-4a9c-a5c6-6773e1c85a40 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:22.492436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:22.493044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.493317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.493586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.494234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:22.496285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:22.527602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1168/2315] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:22 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:22.529214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.540129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73779-e80c-4d03-9e81-b007af349ccb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:22.607600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:22.608208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.608492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.608762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.609385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:22.611426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:22.658547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1148/2316] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:22 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:22.662605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.688087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2174d4-7666-4226-9761-d8eac8644c3d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:22.708736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:22.709396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.709743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.710112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.711098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:22.713176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:22.730147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1169/2317] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:22.733471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.745189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fc9ec-0bee-498e-8980-fb7416584c65 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:22.750667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211057-3b8c-4c14-8395-15c6e2d6c10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:22.752360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211057-3b8c-4c14-8395-15c6e2d6c10a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.752964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211057-3b8c-4c14-8395-15c6e2d6c10a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.753308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211057-3b8c-4c14-8395-15c6e2d6c10a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.754123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211057-3b8c-4c14-8395-15c6e2d6c10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:22.755773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211057-3b8c-4c14-8395-15c6e2d6c10a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:22.761736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:22.770030 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1149/2318] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:22.775356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.787834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a33461-b5d2-4fb3-a8f3-ceb3936835fc admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:22.795289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:22.796264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.796590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.809489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] PATH_INFO: `/v3/projects/1fa7d0c19ff24a2e96b2514743aadd36/users/3d09ef042aef4970a09d06a306abefd6/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.830430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa7d0c19ff24a2e96b2514743aadd36, user_id=3d09ef042aef4970a09d06a306abefd6, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:22.833089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:22.847759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1170/2319] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:22 2022] PUT /identity/v3/projects/1fa7d0c19ff24a2e96b2514743aadd36/users/3d09ef042aef4970a09d06a306abefd6/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:22.858173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985748-4c03-4229-9ab2-fe96614a7d3a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:22.858547 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985748-4c03-4229-9ab2-fe96614a7d3a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:22.858916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985748-4c03-4229-9ab2-fe96614a7d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:22.888147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-84985748-4c03-4229-9ab2-fe96614a7d3a None None] MFA Rules not processed for user `3d09ef042aef4970a09d06a306abefd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:22.889385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-84985748-4c03-4229-9ab2-fe96614a7d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:22.961053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1150/2320] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:30:22.965451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:22.981748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:23.050000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2a8b-1e10-4c98-b100-cde1726a449a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.066484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.067001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.067527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.067831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.068891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.071329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.104082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1171/2321] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:22 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:30:23.106198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985748-4c03-4229-9ab2-fe96614a7d3a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.119861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985748-4c03-4229-9ab2-fe96614a7d3a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.182349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.182967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.183249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.183525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.184235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.186216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.210166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1151/2322] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:23 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:23.212694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.223108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69de32b-c37b-4f4c-b838-498f34573fed admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.227774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.228368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.228647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.228921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.229589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.231254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.242582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1172/2323] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:23.246661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.257137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd688b9-7ff0-4170-bfa8-c24f00ef2165 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.261707 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b055f7-7808-4d67-be10-be3de90efa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.262328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b055f7-7808-4d67-be10-be3de90efa0b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.262605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b055f7-7808-4d67-be10-be3de90efa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.262875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b055f7-7808-4d67-be10-be3de90efa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.263509 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b055f7-7808-4d67-be10-be3de90efa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.265089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b055f7-7808-4d67-be10-be3de90efa0b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.274890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1152/2324] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:23.279024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.289354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ed5d4-8647-40ea-a39e-56efd23deeb6 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.293984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.294711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.294991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.295264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] PATH_INFO: `/v3/projects/5ace9ffdb2cd4aca9a7e1c9ea6da2be8/users/65c8bad59792451880a7ecf36d04fb67/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.310222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ace9ffdb2cd4aca9a7e1c9ea6da2be8, user_id=65c8bad59792451880a7ecf36d04fb67, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.312862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.327234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1173/2325] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:23 2022] PUT /identity/v3/projects/5ace9ffdb2cd4aca9a7e1c9ea6da2be8/users/65c8bad59792451880a7ecf36d04fb67/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:23.338179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b47b8a-41d1-45cd-af3a-eb9e5455e520 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.338676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b47b8a-41d1-45cd-af3a-eb9e5455e520 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.338797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b47b8a-41d1-45cd-af3a-eb9e5455e520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.367305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e1b47b8a-41d1-45cd-af3a-eb9e5455e520 None None] MFA Rules not processed for user `65c8bad59792451880a7ecf36d04fb67`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:23.368548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e1b47b8a-41d1-45cd-af3a-eb9e5455e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:23.427900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:23.437538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1153/2326] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:23.438742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.500618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbecc2-0d22-4a2d-b0f6-4d01e228616b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.505710 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.506335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.506614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.506883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.507497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.509595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.535674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1174/2327] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:23 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:23.539786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b47b8a-41d1-45cd-af3a-eb9e5455e520 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.550615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b47b8a-41d1-45cd-af3a-eb9e5455e520 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.606165 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.606773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.607050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.607324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.607960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.609869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.632831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1154/2328] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:23 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:30:23.635090 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.645915 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df5d2f-3eaf-47ff-9b74-510dac443fdc admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.650601 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.651188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.651467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.651737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.652377 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.653978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.664881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1175/2329] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:23.669229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.679219 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc99d66-d08e-42b9-bcc7-dfa3bf502824 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.684313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.684966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.685249 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.685526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] PATH_INFO: `/v3/projects/4de3e6b28120493dae5943ae98d3e9a6/users/fba2a104e1ef4a639514a7b4ce9c162e/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.702277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de3e6b28120493dae5943ae98d3e9a6, user_id=fba2a104e1ef4a639514a7b4ce9c162e, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.706376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.722337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1155/2330] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:23 2022] PUT /identity/v3/projects/4de3e6b28120493dae5943ae98d3e9a6/users/fba2a104e1ef4a639514a7b4ce9c162e/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:23.726773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.740234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ba68d-0b9e-472e-8f20-5b15544f4138 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.786097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:23.826833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a00f60-0a5e-4c28-82aa-f3245e284d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.827512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00f60-0a5e-4c28-82aa-f3245e284d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.827792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00f60-0a5e-4c28-82aa-f3245e284d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.828064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a00f60-0a5e-4c28-82aa-f3245e284d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.828897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a00f60-0a5e-4c28-82aa-f3245e284d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.831709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a00f60-0a5e-4c28-82aa-f3245e284d41 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.845516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1176/2331] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:23.850711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:23.867347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3334ab8-7b08-4e86-b87f-589721a45a5b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:23.876332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:23.877350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.877466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.877927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] PATH_INFO: `/v3/projects/4de3e6b28120493dae5943ae98d3e9a6/users/fba2a104e1ef4a639514a7b4ce9c162e/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.882721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de3e6b28120493dae5943ae98d3e9a6, user_id=fba2a104e1ef4a639514a7b4ce9c162e, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:23.885372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:23.898094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1156/2332] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:23 2022] PUT /identity/v3/projects/4de3e6b28120493dae5943ae98d3e9a6/users/fba2a104e1ef4a639514a7b4ce9c162e/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:23.908360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:23.908925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:23.909662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:23.947528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] MFA Rules not processed for user `fba2a104e1ef4a639514a7b4ce9c162e`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:23.948916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:24.096271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1177/2333] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:24.130711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:24.133050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:24.227268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718458-6842-4ea6-8f49-1bd4696306ab admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:24.233255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ff820-5b1c-487f-8aeb-0f5c40eb7dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:24.234360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff820-5b1c-487f-8aeb-0f5c40eb7dbd service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:24.234736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff820-5b1c-487f-8aeb-0f5c40eb7dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:24.236458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ff820-5b1c-487f-8aeb-0f5c40eb7dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:24.320891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff820-5b1c-487f-8aeb-0f5c40eb7dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:24.322661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ff820-5b1c-487f-8aeb-0f5c40eb7dbd service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:24.334347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1157/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:25.304292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:25.305698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:25.447874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a6019-ceb9-4645-b10a-9203311212c2 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:25.465607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:25.466310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:25.466578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:25.466843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] PATH_INFO: `/v3/users/138c7dc304c3412d818e857c98d88973` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:25.468077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=138c7dc304c3412d818e857c98d88973)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:25.470507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:25.552749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138c7dc304c3412d818e857c98d88973'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:25.565732 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138c7dc304c3412d818e857c98d88973'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:25.567258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138c7dc304c3412d818e857c98d88973'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:25.585175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:25.589921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138c7dc304c3412d818e857c98d88973'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:25.592080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138c7dc304c3412d818e857c98d88973'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:25.648688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1178/2335] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:25 2022] DELETE /identity/v3/users/138c7dc304c3412d818e857c98d88973 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:25.656073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:25.657697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:25.657984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:25.685737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:25.735171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:25.737217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:25.930553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1158/2336] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:25.934991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:25.936581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:26.017143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:26.017673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2379a-fb6b-4e7b-9495-a3c67e2881a2 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:26.018803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:26.022712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:26.023479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:26.023760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:26.024030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:26.036671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:26.038635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:26.054909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1179/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:30:26.123180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ff8b3-9822-4aae-9050-0d5d23af7724 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:26.127578 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4258c72-351e-46d7-84a5-8417d9357b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:26.128200 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258c72-351e-46d7-84a5-8417d9357b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:26.128926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258c72-351e-46d7-84a5-8417d9357b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:26.129233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258c72-351e-46d7-84a5-8417d9357b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:26.131259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f4258c72-351e-46d7-84a5-8417d9357b5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:26.314753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258c72-351e-46d7-84a5-8417d9357b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:26.316220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258c72-351e-46d7-84a5-8417d9357b5a service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:26.374919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1159/2338] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:30:26.514643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:26.516418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:26.541404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baad172-91f5-4549-aadf-38970dc83955 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:26.547984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:26.548840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:26.549505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:26.550098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] PATH_INFO: `/v3/projects/869c8a45542445e0a8f232d190d5e7fe` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:26.553069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] RBAC: Authorizing `identity:delete_project(project_id=869c8a45542445e0a8f232d190d5e7fe)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:26.556840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:26.647961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869c8a45542445e0a8f232d190d5e7fe', 'request_id': 'req-6efb9343-41c6-4355-8fa5-7a7138c0465b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:26.679078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869c8a45542445e0a8f232d190d5e7fe', 'request_id': 'req-6efb9343-41c6-4355-8fa5-7a7138c0465b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:26.710925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869c8a45542445e0a8f232d190d5e7fe', 'request_id': 'req-6efb9343-41c6-4355-8fa5-7a7138c0465b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:26.760093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] The token cache is being invalidate because project 869c8a45542445e0a8f232d190d5e7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:26.760457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:26.761404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-6efb9343-41c6-4355-8fa5-7a7138c0465b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:26.764370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1180/2339] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:26 2022] DELETE /identity/v3/projects/869c8a45542445e0a8f232d190d5e7fe => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:26.769510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7d61-f016-4cf5-a2b0-ce6a5589fe21 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:26.770407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7d61-f016-4cf5-a2b0-ce6a5589fe21 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:26.770830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7d61-f016-4cf5-a2b0-ce6a5589fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:26.802502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-eceb7d61-f016-4cf5-a2b0-ce6a5589fe21 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:26.804377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-eceb7d61-f016-4cf5-a2b0-ce6a5589fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:26.967998 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:27.000096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1160/2340] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:27.011932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406c0c-3fe3-4197-ba50-0ecd147e1e6e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.012231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406c0c-3fe3-4197-ba50-0ecd147e1e6e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.012516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67406c0c-3fe3-4197-ba50-0ecd147e1e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.064627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-67406c0c-3fe3-4197-ba50-0ecd147e1e6e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:27.066394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-67406c0c-3fe3-4197-ba50-0ecd147e1e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:27.097022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7d61-f016-4cf5-a2b0-ce6a5589fe21 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:27.108013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1181/2341] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:27.113795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7d61-f016-4cf5-a2b0-ce6a5589fe21 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:27.131397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:27.132017 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.132329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.132716 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.133529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:27.135961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:27.137798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:27.162095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1161/2342] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:30:27.168109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67406c0c-3fe3-4197-ba50-0ecd147e1e6e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:27.186371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67406c0c-3fe3-4197-ba50-0ecd147e1e6e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:27.210021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:27.213560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.214982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.217042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.218382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:27.222083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:27.295652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1182/2343] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:27 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:27.300007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:27.312425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e5ab2-1a6d-4d3d-94b2-efd1c98e36c5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:27.426678 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:27.430111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.430837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.432224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.435550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:27.441319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:27.481592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1162/2344] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:27 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:30:27.490531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:27.558159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ea0f-f08c-4c92-918f-a458474d6f67 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:27.587922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:27.588762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.589795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.590288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.591119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:27.593559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:27.618864 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1183/2345] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:27.620893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:27.647426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5fc42-0e5d-4a0d-a5c0-2c4babbf7149 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:27.670605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:27.670605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.670605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.670605 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.671000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:27.671000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:27.684079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1163/2346] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:27.689665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:27.711948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538676b8-2c1f-4229-87b1-49c5f72c3d7b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:27.720531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93d664-9ef0-46d0-b169-f76c53ab62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:27.722166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d664-9ef0-46d0-b169-f76c53ab62f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.722707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d664-9ef0-46d0-b169-f76c53ab62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.723181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d664-9ef0-46d0-b169-f76c53ab62f7 admin admin] PATH_INFO: `/v3/projects/2475a28f857445dca2115e109b3a58c6/users/5a0b379c8c3641adafc3cd202cb06862/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.726920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:27.728108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:27.765659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93d664-9ef0-46d0-b169-f76c53ab62f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2475a28f857445dca2115e109b3a58c6, user_id=5a0b379c8c3641adafc3cd202cb06862, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:27.765659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93d664-9ef0-46d0-b169-f76c53ab62f7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:27.779053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:27.787323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1184/2347] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:27 2022] PUT /identity/v3/projects/2475a28f857445dca2115e109b3a58c6/users/5a0b379c8c3641adafc3cd202cb06862/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:30:27.801488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a416e-170e-4678-941e-7117eaeaaecf None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.802789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a416e-170e-4678-941e-7117eaeaaecf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.803569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a416e-170e-4678-941e-7117eaeaaecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.824606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a59a0-b95a-49ff-8297-d7862b1a126b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:27.886515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-de7a416e-170e-4678-941e-7117eaeaaecf None None] MFA Rules not processed for user `5a0b379c8c3641adafc3cd202cb06862`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:27.887805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-de7a416e-170e-4678-941e-7117eaeaaecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:27.913725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:27.914674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:27.915108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:27.915533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:27.917775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:28.011459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:28.023015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1185/2348] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:28.024736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a416e-170e-4678-941e-7117eaeaaecf None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:28.074992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:28.076862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:28.091302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1164/2349] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:30:28.180373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a416e-170e-4678-941e-7117eaeaaecf None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:28.185965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:28.186623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:28.186902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:28.187181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:28.188809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:28.191294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:28.241465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1186/2350] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:28 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:28.245550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:28.261629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38723d28-609a-4c19-83f7-c84cd483f7f4 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:28.364660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:28.365775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:28.366465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:28.366951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:28.367820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:28.384228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:28.439801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1165/2351] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:28 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:28.443383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:28.457409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37b195-c552-4bdf-8412-14b4b98b429a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:28.463590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:28.465424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:28.465653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:28.465932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:28.466644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:28.470888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:28.511553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:28.512090 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1187/2352] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:28.541275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61628b94-e512-4f61-b78f-3d21c2cad738 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:28.573504 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d846-96c8-4211-8fc6-0aff420205eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:28.574313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d846-96c8-4211-8fc6-0aff420205eb admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:28.574727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d846-96c8-4211-8fc6-0aff420205eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:28.575210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d846-96c8-4211-8fc6-0aff420205eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:28.575862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d846-96c8-4211-8fc6-0aff420205eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:28.577456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d846-96c8-4211-8fc6-0aff420205eb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:28.611008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1166/2353] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:28.613696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:28.630695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7eaeb-72bf-466d-9a47-f449511581e4 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:28.640670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:28.641439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:28.641713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:28.642212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] PATH_INFO: `/v3/projects/310ebaca993b40779992bfa395961ee3/users/83a4e107a7a6490c968368606e1fe21f/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:28.673849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310ebaca993b40779992bfa395961ee3, user_id=83a4e107a7a6490c968368606e1fe21f, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:28.676668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:28.710485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1188/2354] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:28 2022] PUT /identity/v3/projects/310ebaca993b40779992bfa395961ee3/users/83a4e107a7a6490c968368606e1fe21f/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:28.718071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f95c0-e8df-44ff-b43d-7eb6d5d9413a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:28.719592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f95c0-e8df-44ff-b43d-7eb6d5d9413a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:28.720008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f95c0-e8df-44ff-b43d-7eb6d5d9413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:28.763050 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5d3f95c0-e8df-44ff-b43d-7eb6d5d9413a None None] MFA Rules not processed for user `83a4e107a7a6490c968368606e1fe21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:28.765926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5d3f95c0-e8df-44ff-b43d-7eb6d5d9413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:28.882875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1167/2355] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:28.887634 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:28.937576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:28.970275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f81df-0843-438e-94c8-0910ed4a3e52 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:28.975311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:28.975920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:28.976197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:28.976468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:28.977100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:28.981094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:29.026975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f95c0-e8df-44ff-b43d-7eb6d5d9413a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:29.027785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1189/2356] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:28 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:29.060505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f95c0-e8df-44ff-b43d-7eb6d5d9413a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:29.103774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:29.143376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:29.144008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:29.144840 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:29.145135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:29.145943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:29.149238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:29.218183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1168/2357] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:29 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:29.222344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:29.238941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780238c-de98-4f50-ad28-627238a2b3a9 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:29.248452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:29.249214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:29.249885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:29.249885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:29.250539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:29.252870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:29.278112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1190/2358] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:29.280438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:29.292080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1a790-1a07-4da2-abbe-425e4bce3289 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:29.297797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:29.298750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:29.299010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:29.299318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] PATH_INFO: `/v3/projects/9a3144c0bf064ff8a8e3bbc4210292ca/users/74ff4c6dfe4746f4ba817285c47ebc28/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:29.324457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3144c0bf064ff8a8e3bbc4210292ca, user_id=74ff4c6dfe4746f4ba817285c47ebc28, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:29.327492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:29.343550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1169/2359] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:29 2022] PUT /identity/v3/projects/9a3144c0bf064ff8a8e3bbc4210292ca/users/74ff4c6dfe4746f4ba817285c47ebc28/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:29.350026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:29.366212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0ec80-d369-40f6-9928-a8686759720a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:29.481474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e7c37-e363-49ff-8f50-45d3397cf597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:29.486352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7c37-e363-49ff-8f50-45d3397cf597 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:29.488164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7c37-e363-49ff-8f50-45d3397cf597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:29.488690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e7c37-e363-49ff-8f50-45d3397cf597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:29.489515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7c37-e363-49ff-8f50-45d3397cf597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:29.491497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e7c37-e363-49ff-8f50-45d3397cf597 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:29.506502 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1191/2360] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:29.508937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:29.527923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86083b-5951-43bb-a6b0-3d4db01754c3 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:29.537510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:29.538266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:29.538544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:29.538818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] PATH_INFO: `/v3/projects/9a3144c0bf064ff8a8e3bbc4210292ca/users/74ff4c6dfe4746f4ba817285c47ebc28/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:29.544004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3144c0bf064ff8a8e3bbc4210292ca, user_id=74ff4c6dfe4746f4ba817285c47ebc28, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:29.546704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:29.558611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1170/2361] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:29 2022] PUT /identity/v3/projects/9a3144c0bf064ff8a8e3bbc4210292ca/users/74ff4c6dfe4746f4ba817285c47ebc28/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:29.569364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:29.569756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:29.570148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:29.642389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] MFA Rules not processed for user `74ff4c6dfe4746f4ba817285c47ebc28`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:29.643627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:29.768968 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1192/2362] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:30:29.781393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:29.864897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94a86-ea9c-47d8-8bb5-ffe50d50a2ed admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:29.868913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:29.869665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:29.869949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:29.870267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:29.951591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:29.958425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:29.971766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1171/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:31.639576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:31.641690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:31.661933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f2eb-cf8d-4505-a392-092f5dc0c215 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:31.665531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999cdc6-4f4d-4e39-a24e-cab24f9898ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:31.666196 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999cdc6-4f4d-4e39-a24e-cab24f9898ba service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:31.666651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999cdc6-4f4d-4e39-a24e-cab24f9898ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:31.667077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999cdc6-4f4d-4e39-a24e-cab24f9898ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:31.707780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:31.735957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999cdc6-4f4d-4e39-a24e-cab24f9898ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:31.737413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999cdc6-4f4d-4e39-a24e-cab24f9898ba service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:31.747778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1193/2364] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:32.279155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:32.282329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:32.347279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:32.378911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f3e52-d22a-4a17-b24a-4de50d5aa402 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:32.384154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:32.384869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:32.385273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:32.385617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] PATH_INFO: `/v3/users/3d09ef042aef4970a09d06a306abefd6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:32.386864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d09ef042aef4970a09d06a306abefd6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:32.388861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:32.468370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d09ef042aef4970a09d06a306abefd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:32.469642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d09ef042aef4970a09d06a306abefd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:32.470328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d09ef042aef4970a09d06a306abefd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:32.480079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d09ef042aef4970a09d06a306abefd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:32.493355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d09ef042aef4970a09d06a306abefd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:32.520077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1172/2365] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:32 2022] DELETE /identity/v3/users/3d09ef042aef4970a09d06a306abefd6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:32.524722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:32.525180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:32.525800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:32.552586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:32.553846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:32.570342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:32.574550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:32.623032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1194/2366] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:32.633761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:32.635203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:32.638702 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa68cfa-ce7e-47ef-afa3-b694aeb2aad0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:32.643244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:32.643880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:32.644174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:32.644459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:32.646256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:32.712555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec76c5d-803a-4578-927d-dc61292235c0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:32.717184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:32.718164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:32.718537 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:32.720493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:32.736184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:32.738371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:32.743815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:32.746121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:32.753577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1195/2367] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:30:32.761106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1173/2368] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:30:33.114093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:33.115191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:33.133385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988aae1-e716-4017-90a4-29a12b9a1ee5 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:33.139886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:33.141315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:33.141315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:33.141632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] PATH_INFO: `/v3/projects/1fa7d0c19ff24a2e96b2514743aadd36` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:33.142888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa7d0c19ff24a2e96b2514743aadd36)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:33.144793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:33.196703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa7d0c19ff24a2e96b2514743aadd36', 'request_id': 'req-f51ca991-6812-4ee5-a98f-65d9141fc60f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.202817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa7d0c19ff24a2e96b2514743aadd36', 'request_id': 'req-f51ca991-6812-4ee5-a98f-65d9141fc60f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.212844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa7d0c19ff24a2e96b2514743aadd36', 'request_id': 'req-f51ca991-6812-4ee5-a98f-65d9141fc60f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.223866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:33.228894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] The token cache is being invalidate because project 1fa7d0c19ff24a2e96b2514743aadd36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:33.229221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.230278 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.232038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1196/2369] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:33 2022] DELETE /identity/v3/projects/1fa7d0c19ff24a2e96b2514743aadd36 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:33.236629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:33.248339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308de88-4a52-4ff4-964f-a876056d3e63 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:33.261524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:33.322126 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:33.323468 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:33.323944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:33.324220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] PATH_INFO: `/v3/users/65c8bad59792451880a7ecf36d04fb67` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:33.325391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c8bad59792451880a7ecf36d04fb67)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:33.327371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:33.380154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c8bad59792451880a7ecf36d04fb67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.380829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c8bad59792451880a7ecf36d04fb67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.381425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c8bad59792451880a7ecf36d04fb67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.389248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c8bad59792451880a7ecf36d04fb67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.397497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c8bad59792451880a7ecf36d04fb67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.419257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1174/2370] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:33 2022] DELETE /identity/v3/users/65c8bad59792451880a7ecf36d04fb67 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:33.755516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:33.757154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:33.783662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ca991-6812-4ee5-a98f-65d9141fc60f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:33.853424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:33.854083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:33.854365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:33.855000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] PATH_INFO: `/v3/projects/5ace9ffdb2cd4aca9a7e1c9ea6da2be8` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:33.856234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ace9ffdb2cd4aca9a7e1c9ea6da2be8)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:33.858384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:33.912139 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ace9ffdb2cd4aca9a7e1c9ea6da2be8', 'request_id': 'req-f3010d23-3f32-46c9-92ba-c55c011687c5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.918412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ace9ffdb2cd4aca9a7e1c9ea6da2be8', 'request_id': 'req-f3010d23-3f32-46c9-92ba-c55c011687c5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.938045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ace9ffdb2cd4aca9a7e1c9ea6da2be8', 'request_id': 'req-f3010d23-3f32-46c9-92ba-c55c011687c5'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.957091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] The token cache is being invalidate because project 5ace9ffdb2cd4aca9a7e1c9ea6da2be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:33.957714 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.959530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:33.964251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1197/2371] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:33 2022] DELETE /identity/v3/projects/5ace9ffdb2cd4aca9a7e1c9ea6da2be8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:33.965846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:33.967214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:33.986433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bec68-b28f-47c5-ba06-d46b939717b0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:34.110806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:34.111873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:34.112213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:34.112556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] PATH_INFO: `/v3/users/fba2a104e1ef4a639514a7b4ce9c162e` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:34.114267 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba2a104e1ef4a639514a7b4ce9c162e)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:34.117691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:34.212347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:34.238125 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba2a104e1ef4a639514a7b4ce9c162e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:34.243117 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba2a104e1ef4a639514a7b4ce9c162e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:34.244178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba2a104e1ef4a639514a7b4ce9c162e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:34.262756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba2a104e1ef4a639514a7b4ce9c162e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:34.301218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c9f1b8d-4e7f-461f-9978-a6040fdd30fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba2a104e1ef4a639514a7b4ce9c162e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:34.348730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1175/2372] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:33 2022] DELETE /identity/v3/users/fba2a104e1ef4a639514a7b4ce9c162e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:34.868600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:34.870401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:34.887830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010d23-3f32-46c9-92ba-c55c011687c5 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:34.954166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:34.954688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:34.954967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:34.955236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] PATH_INFO: `/v3/projects/4de3e6b28120493dae5943ae98d3e9a6` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:34.956420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de3e6b28120493dae5943ae98d3e9a6)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:34.958383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:34.994874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:35.008565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de3e6b28120493dae5943ae98d3e9a6', 'request_id': 'req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:35.015047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de3e6b28120493dae5943ae98d3e9a6', 'request_id': 'req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:35.023756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de3e6b28120493dae5943ae98d3e9a6', 'request_id': 'req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:35.035212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] The token cache is being invalidate because project 4de3e6b28120493dae5943ae98d3e9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:35.035512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:35.036123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c1ca4495-bbc9-47e1-acd9-94902a6c17ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:35.037589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1198/2373] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:34 2022] DELETE /identity/v3/projects/4de3e6b28120493dae5943ae98d3e9a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:35.042519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c871f5-30e4-4356-a416-636325359824 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.042807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c871f5-30e4-4356-a416-636325359824 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.043082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c871f5-30e4-4356-a416-636325359824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.065113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-47c871f5-30e4-4356-a416-636325359824 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:35.065662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-47c871f5-30e4-4356-a416-636325359824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:35.130008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1176/2374] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:35.137900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb395199-31fd-4504-a344-25af2a2746a6 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.138249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb395199-31fd-4504-a344-25af2a2746a6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.138526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb395199-31fd-4504-a344-25af2a2746a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.159172 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-cb395199-31fd-4504-a344-25af2a2746a6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:35.160358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cb395199-31fd-4504-a344-25af2a2746a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:35.168794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1199/2375] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:35.173435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c871f5-30e4-4356-a416-636325359824 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:35.184238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c871f5-30e4-4356-a416-636325359824 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:35.189552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:35.190222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.190502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.190770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.191421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:35.191748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:35.193342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:35.205845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1177/2376] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:30:35.210247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb395199-31fd-4504-a344-25af2a2746a6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:35.220525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb395199-31fd-4504-a344-25af2a2746a6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:35.225221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:35.225822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.226163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.226447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.227087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:35.228990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:35.256957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1200/2377] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:35 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:30:35.261121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:35.274292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bf902-9fa1-4fa5-835c-7922791da1df admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:35.334206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:35.334808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.335084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.335351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.335989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:35.337886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:35.361556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1178/2378] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:35 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:35.365607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:35.379106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f73106-5118-444f-b772-086d29f33f6d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:35.386474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:35.387094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.387635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.387795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.388443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:35.390155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:35.402007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1201/2379] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:35.405931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:35.417664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2add94-e90b-4a72-9e7e-d76d020d3d36 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:35.430244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dfbd3-ccbc-401d-aeb2-08411aef96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:35.430244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfbd3-ccbc-401d-aeb2-08411aef96ca admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.430244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfbd3-ccbc-401d-aeb2-08411aef96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.430549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dfbd3-ccbc-401d-aeb2-08411aef96ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.430945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dfbd3-ccbc-401d-aeb2-08411aef96ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:35.432732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8dfbd3-ccbc-401d-aeb2-08411aef96ca admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:35.445354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1179/2380] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:35.453889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:35.464237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1c512-4849-407b-916c-017614bf52f1 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:35.470188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:35.470920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.471261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.471595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] PATH_INFO: `/v3/projects/b6856ec96e794c7f89c7abfcde9515bd/users/647dba51cc91483d84548e14c4c65d26/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.489042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6856ec96e794c7f89c7abfcde9515bd, user_id=647dba51cc91483d84548e14c4c65d26, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:35.492226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:35.529118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1202/2381] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:35 2022] PUT /identity/v3/projects/b6856ec96e794c7f89c7abfcde9515bd/users/647dba51cc91483d84548e14c4c65d26/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:35.611340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fbc5a-8c18-4cf9-86e5-79d9cc21c558 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.611621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fbc5a-8c18-4cf9-86e5-79d9cc21c558 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.611892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fbc5a-8c18-4cf9-86e5-79d9cc21c558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.659052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b56fbc5a-8c18-4cf9-86e5-79d9cc21c558 None None] MFA Rules not processed for user `647dba51cc91483d84548e14c4c65d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:35.660606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b56fbc5a-8c18-4cf9-86e5-79d9cc21c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:35.669164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:35.780322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:35.780751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1180/2382] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:35.957328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9255d-6d88-4ab7-8215-c702c94388b2 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:35.967142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:35.967771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:35.968052 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:35.968531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:35.969618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:35.972259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.045711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1203/2383] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:35 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:36.050626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fbc5a-8c18-4cf9-86e5-79d9cc21c558 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.068071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fbc5a-8c18-4cf9-86e5-79d9cc21c558 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.190085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.190085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.190085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.190085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.190919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.190919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.225351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1181/2384] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:36 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:36.229539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.255355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4764-c1a8-4915-bf3c-a9c1a09202f3 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.265529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.266977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.267420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.267872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.268677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.270529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.293391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1204/2385] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:36.294410 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.306721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82657d35-12c0-445b-b51c-82d6c4b7242e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.312109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d41f5-ea0e-4532-90f1-cd9c817b6be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.313719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d41f5-ea0e-4532-90f1-cd9c817b6be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.314001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d41f5-ea0e-4532-90f1-cd9c817b6be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.314311 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d41f5-ea0e-4532-90f1-cd9c817b6be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.314962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d41f5-ea0e-4532-90f1-cd9c817b6be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.316561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d41f5-ea0e-4532-90f1-cd9c817b6be7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.328717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1182/2386] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:36.333087 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.346206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e56f-255a-43ab-ad1a-a45438eefb98 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.351139 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.351798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.352077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.352344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] PATH_INFO: `/v3/projects/ee12368420364d6d9b9f17823849f96f/users/cbfea233886446b8b1594950d41cb4c0/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.368912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee12368420364d6d9b9f17823849f96f, user_id=cbfea233886446b8b1594950d41cb4c0, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.371884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.386453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1205/2387] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:36 2022] PUT /identity/v3/projects/ee12368420364d6d9b9f17823849f96f/users/cbfea233886446b8b1594950d41cb4c0/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:36.398517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1426d6-da47-4239-b4f6-a397cd58a903 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.399312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1426d6-da47-4239-b4f6-a397cd58a903 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.399730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1426d6-da47-4239-b4f6-a397cd58a903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.430381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3b1426d6-da47-4239-b4f6-a397cd58a903 None None] MFA Rules not processed for user `cbfea233886446b8b1594950d41cb4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:36.431598 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b1426d6-da47-4239-b4f6-a397cd58a903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:36.497879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1183/2388] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:36.502884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.512543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:36.570515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95809214-9324-4d8a-bd22-bb37dc0cd21d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.575319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.575929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.576210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.576486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.577120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.580099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.610623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1206/2389] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:36 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:36.615444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1426d6-da47-4239-b4f6-a397cd58a903 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.629544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1426d6-da47-4239-b4f6-a397cd58a903 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.665508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:36.748256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.748797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.749074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.749346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.750187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.752260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.790279 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1184/2390] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:36 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:36.794440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.805971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baa894-6609-497d-a8dd-1bd6a0111bcf admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.810914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.811629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.812308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.812669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.813594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.815531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.829105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1207/2391] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:36.833218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.844807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad835-05e6-498b-b3a6-1759186fd107 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.849628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.850326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.850604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.850875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] PATH_INFO: `/v3/projects/6bf939a1f2cc4ba588b725e88980fdc3/users/0129bdfadd6744f3a83d931b305a0450/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.865656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf939a1f2cc4ba588b725e88980fdc3, user_id=0129bdfadd6744f3a83d931b305a0450, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.868326 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.881602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1185/2392] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:36 2022] PUT /identity/v3/projects/6bf939a1f2cc4ba588b725e88980fdc3/users/0129bdfadd6744f3a83d931b305a0450/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:36.885621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.899017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc998e3a-bb51-4bf0-865c-7a305109274e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.961654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b2fb4-d26b-4d5d-bbd6-594405a0bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.962322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2fb4-d26b-4d5d-bbd6-594405a0bf41 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.962565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2fb4-d26b-4d5d-bbd6-594405a0bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.962828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b2fb4-d26b-4d5d-bbd6-594405a0bf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.963469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b2fb4-d26b-4d5d-bbd6-594405a0bf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:36.965088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b2fb4-d26b-4d5d-bbd6-594405a0bf41 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:36.975328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1208/2393] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:36.980013 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:36.990266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac778-7353-403f-99a2-da0dc5868696 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:36.994769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:36.995405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:36.995677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:36.995941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] PATH_INFO: `/v3/projects/6bf939a1f2cc4ba588b725e88980fdc3/users/0129bdfadd6744f3a83d931b305a0450/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:36.997976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf939a1f2cc4ba588b725e88980fdc3, user_id=0129bdfadd6744f3a83d931b305a0450, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:37.001359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:37.013441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1186/2394] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:36 2022] PUT /identity/v3/projects/6bf939a1f2cc4ba588b725e88980fdc3/users/0129bdfadd6744f3a83d931b305a0450/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:37.025277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:37.025558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:37.025891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:37.056558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] MFA Rules not processed for user `0129bdfadd6744f3a83d931b305a0450`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:37.057975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:37.148057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1209/2395] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:37.160798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:37.163402 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:37.164119 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:37.165945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:37.174108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:37.267481 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88e5d1-9158-422a-95a8-44cca014e8c7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:37.271458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c9bd4-4615-4632-b4eb-e283960503fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:37.272108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9bd4-4615-4632-b4eb-e283960503fa service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:37.272384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9bd4-4615-4632-b4eb-e283960503fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:37.272653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c9bd4-4615-4632-b4eb-e283960503fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:37.275986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82dbff4-0ad4-4022-ab72-a6040826b8cf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:37.285639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:37.286332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:37.286611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:37.286880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] PATH_INFO: `/v3/users/5a0b379c8c3641adafc3cd202cb06862` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:37.288514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0b379c8c3641adafc3cd202cb06862)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:37.290625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:37.356761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0b379c8c3641adafc3cd202cb06862'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:37.357419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0b379c8c3641adafc3cd202cb06862'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:37.358071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0b379c8c3641adafc3cd202cb06862'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:37.363246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c9bd4-4615-4632-b4eb-e283960503fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:37.364698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c9bd4-4615-4632-b4eb-e283960503fa service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:37.367558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0b379c8c3641adafc3cd202cb06862'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:37.375923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1210/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:37.378485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0b379c8c3641adafc3cd202cb06862'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:37.388248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:37.404137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1187/2397] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:37 2022] DELETE /identity/v3/users/5a0b379c8c3641adafc3cd202cb06862 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:37.410496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:37.410496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:37.410496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:37.467719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:37.470112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:37.568993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1211/2398] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:37.580552 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:37.582560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:37.656527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e65391-7120-4ec8-8527-2b07a6d3387e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:37.656527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:37.656527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:37.656816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:37.656919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:37.667916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:37.669646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:37.681035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1188/2399] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:38.091758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:38.107602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:38.121957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fced3d-6c91-4de9-b656-cd03f8fc6b63 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:38.127574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:38.128134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:38.128510 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:38.128879 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] PATH_INFO: `/v3/projects/2475a28f857445dca2115e109b3a58c6` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:38.130145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2475a28f857445dca2115e109b3a58c6)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:38.132148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:38.193414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2475a28f857445dca2115e109b3a58c6', 'request_id': 'req-845e6e18-e5c0-464f-bca8-dcf3f73d5817'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.196162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:38.201011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2475a28f857445dca2115e109b3a58c6', 'request_id': 'req-845e6e18-e5c0-464f-bca8-dcf3f73d5817'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.214318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2475a28f857445dca2115e109b3a58c6', 'request_id': 'req-845e6e18-e5c0-464f-bca8-dcf3f73d5817'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.232043 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] The token cache is being invalidate because project 2475a28f857445dca2115e109b3a58c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:38.232369 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.233637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.235975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1212/2400] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:38 2022] DELETE /identity/v3/projects/2475a28f857445dca2115e109b3a58c6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:38.240055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:38.252151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fb814-e617-457d-9f1c-0ae49086d91e service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:38.335799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:38.336813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:38.337837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:38.338378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] PATH_INFO: `/v3/users/83a4e107a7a6490c968368606e1fe21f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:38.340273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a4e107a7a6490c968368606e1fe21f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:38.342723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:38.398444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a4e107a7a6490c968368606e1fe21f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.399097 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a4e107a7a6490c968368606e1fe21f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.399707 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a4e107a7a6490c968368606e1fe21f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.408149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a4e107a7a6490c968368606e1fe21f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.417747 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a4e107a7a6490c968368606e1fe21f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:38.438774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1189/2401] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:38 2022] DELETE /identity/v3/users/83a4e107a7a6490c968368606e1fe21f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:38.901889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:38.904108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:38.926015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6e18-e5c0-464f-bca8-dcf3f73d5817 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:39.012571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:39.013292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:39.013646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:39.014153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] PATH_INFO: `/v3/projects/310ebaca993b40779992bfa395961ee3` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:39.022115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310ebaca993b40779992bfa395961ee3)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:39.022115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:39.052454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:39.053892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:39.073984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310ebaca993b40779992bfa395961ee3', 'request_id': 'req-a2e80f49-9495-48be-bb65-624eae6c6208'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.083110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310ebaca993b40779992bfa395961ee3', 'request_id': 'req-a2e80f49-9495-48be-bb65-624eae6c6208'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.084524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:39.091640 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310ebaca993b40779992bfa395961ee3', 'request_id': 'req-a2e80f49-9495-48be-bb65-624eae6c6208'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.104340 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] The token cache is being invalidate because project 310ebaca993b40779992bfa395961ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:39.105025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.105674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.107309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1213/2402] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:38 2022] DELETE /identity/v3/projects/310ebaca993b40779992bfa395961ee3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:39.111073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:39.112562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:39.134779 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffae78-74a6-4f63-94da-c54006963900 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:39.181315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e80f49-9495-48be-bb65-624eae6c6208 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:39.188506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:39.189156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:39.189557 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:39.189852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] PATH_INFO: `/v3/users/74ff4c6dfe4746f4ba817285c47ebc28` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:39.191513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ff4c6dfe4746f4ba817285c47ebc28)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:39.193133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:39.193467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:39.193886 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:39.194288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:39.194635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:39.196536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:39.212014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:39.248821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ff4c6dfe4746f4ba817285c47ebc28'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.257454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ff4c6dfe4746f4ba817285c47ebc28'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.258173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ff4c6dfe4746f4ba817285c47ebc28'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.266020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ff4c6dfe4746f4ba817285c47ebc28'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.266187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:39.266698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ff4c6dfe4746f4ba817285c47ebc28'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.267562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:39.276601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1190/2403] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:39.287382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1214/2404] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:39 2022] DELETE /identity/v3/users/74ff4c6dfe4746f4ba817285c47ebc28 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:39.686038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:39.708132 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b5c2a-fe92-43c6-abd8-97aebdf7db49 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:39.787758 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:39.788711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:39.789239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:39.794212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] PATH_INFO: `/v3/projects/9a3144c0bf064ff8a8e3bbc4210292ca` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:39.795503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3144c0bf064ff8a8e3bbc4210292ca)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:39.798417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:39.830362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:39.879865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3144c0bf064ff8a8e3bbc4210292ca', 'request_id': 'req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.891850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3144c0bf064ff8a8e3bbc4210292ca', 'request_id': 'req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.905208 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3144c0bf064ff8a8e3bbc4210292ca', 'request_id': 'req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.932302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] The token cache is being invalidate because project 9a3144c0bf064ff8a8e3bbc4210292ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:39.932942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.934692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:39.939384 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1191/2405] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:39 2022] DELETE /identity/v3/projects/9a3144c0bf064ff8a8e3bbc4210292ca => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:40.020941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:40.022896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:40.181142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3604223-3bb1-42a3-8879-a83d1f754a83 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:40.246581 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291182f1-fd66-4d9d-bb0d-632503141ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:40.247185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291182f1-fd66-4d9d-bb0d-632503141ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:40.247460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291182f1-fd66-4d9d-bb0d-632503141ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:40.247728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291182f1-fd66-4d9d-bb0d-632503141ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:40.250315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-291182f1-fd66-4d9d-bb0d-632503141ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:40.344796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:40.347991 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291182f1-fd66-4d9d-bb0d-632503141ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:40.349117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291182f1-fd66-4d9d-bb0d-632503141ec2 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:40.370495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1215/2406] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:40.521395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:40.523037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:40.599906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38c39b-9a8d-43d7-ad1d-5c281d8b6da9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:40.604137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:40.604765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:40.605069 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:40.605343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:40.607799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:40.699012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:40.701880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:40.735736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1192/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:40.793147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:40.793452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:40.793827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:40.821061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:40.821061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:40.892899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1216/2408] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:30:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:40.915843 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:40.917296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:40.995616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:41.001106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a18f87-5ded-4680-b818-3962560aed30 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:41.007305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0e573-26cf-4b4f-89f4-ca217ef26ff1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:41.008222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e573-26cf-4b4f-89f4-ca217ef26ff1 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:41.008517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e573-26cf-4b4f-89f4-ca217ef26ff1 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:41.008985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0e573-26cf-4b4f-89f4-ca217ef26ff1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:41.021180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0e573-26cf-4b4f-89f4-ca217ef26ff1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:41.022785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f0e573-26cf-4b4f-89f4-ca217ef26ff1 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:41.031382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1193/2409] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:30:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:30:45.418214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:45.422599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:45.566635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda312b-f52d-4282-8d5a-0298c3317fe4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:45.578350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:45.578610 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:45.579214 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:45.579355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] PATH_INFO: `/v3/users/647dba51cc91483d84548e14c4c65d26` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:45.581159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647dba51cc91483d84548e14c4c65d26)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:45.583614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:45.726951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647dba51cc91483d84548e14c4c65d26'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:45.743631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647dba51cc91483d84548e14c4c65d26'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:45.746527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647dba51cc91483d84548e14c4c65d26'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:45.759880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647dba51cc91483d84548e14c4c65d26'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:45.762565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647dba51cc91483d84548e14c4c65d26'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:45.815223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1217/2410] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:45 2022] DELETE /identity/v3/users/647dba51cc91483d84548e14c4c65d26 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:45.816956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:45.817498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:45.820656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:45.888023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:45.892759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:46.083892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1194/2411] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:46.098187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:46.102892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:46.153789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:46.291254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42201f49-f0a8-4d06-ba67-4515c55cd5a9 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:46.299166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:46.299919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:46.304271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:46.306647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:46.340267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:46.342844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:46.375494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1218/2412] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:47.071328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:47.093021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:47.115770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:47.118560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:47.135865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b63b-293b-4366-80e1-72e3aaeea96a service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:47.136108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82987933-1a5b-4c9d-ac54-9a6c2c49b82e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:47.141143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:47.141787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:47.142077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:47.143155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:47.143298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:47.143506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:47.143778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] PATH_INFO: `/v3/projects/b6856ec96e794c7f89c7abfcde9515bd` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:47.143901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] PATH_INFO: `/v3/users/c6dbf29ce67d40debcd082dfff60aa81` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:47.144916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6856ec96e794c7f89c7abfcde9515bd)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:47.145057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6dbf29ce67d40debcd082dfff60aa81)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:47.147037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:47.147288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:47.241370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6856ec96e794c7f89c7abfcde9515bd', 'request_id': 'req-57d5c55d-290b-459a-9d71-0adbe7b3bddd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.255821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6856ec96e794c7f89c7abfcde9515bd', 'request_id': 'req-57d5c55d-290b-459a-9d71-0adbe7b3bddd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.260346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6dbf29ce67d40debcd082dfff60aa81'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.265997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6856ec96e794c7f89c7abfcde9515bd', 'request_id': 'req-57d5c55d-290b-459a-9d71-0adbe7b3bddd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.279592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6dbf29ce67d40debcd082dfff60aa81'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.281153 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6dbf29ce67d40debcd082dfff60aa81'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.289739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] The token cache is being invalidate because project b6856ec96e794c7f89c7abfcde9515bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:47.290424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.291918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.296633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1195/2413] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:47 2022] DELETE /identity/v3/projects/b6856ec96e794c7f89c7abfcde9515bd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:47.302189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:47.304350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:47.314984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6dbf29ce67d40debcd082dfff60aa81'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.316716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e58ef10b-34e9-418c-918e-87f95e5b0ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6dbf29ce67d40debcd082dfff60aa81'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.365069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1219/2414] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:47 2022] DELETE /identity/v3/users/c6dbf29ce67d40debcd082dfff60aa81 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:30:47.370469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:47.370819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:47.371103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:47.419266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:47.420573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:47.427123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5c55d-290b-459a-9d71-0adbe7b3bddd admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:47.484063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:47.573472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:47.574574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:47.578610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:47.579237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] PATH_INFO: `/v3/users/cbfea233886446b8b1594950d41cb4c0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:47.581968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfea233886446b8b1594950d41cb4c0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:47.584379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:47.603311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1220/2415] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:30:47.612839 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:47.619423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:47.688675 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfea233886446b8b1594950d41cb4c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.689448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfea233886446b8b1594950d41cb4c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.690643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfea233886446b8b1594950d41cb4c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.699832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfea233886446b8b1594950d41cb4c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.708660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:47.715364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c452494-7172-41a2-8720-db4f2f37b1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfea233886446b8b1594950d41cb4c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:47.756756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1196/2416] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:47 2022] DELETE /identity/v3/users/cbfea233886446b8b1594950d41cb4c0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:47.762651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea69cb-f18d-4a8e-8d24-e0632df7e5a0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:47.854857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:47.855651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:47.856081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:47.856358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:47.858803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:47.978802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:47.980522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:47.998226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1221/2417] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:48.150091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8536d4-a7e6-4cc6-b7a3-a2e50f02f173 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:48.151400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8536d4-a7e6-4cc6-b7a3-a2e50f02f173 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:48.151945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8536d4-a7e6-4cc6-b7a3-a2e50f02f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:48.192282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6a8536d4-a7e6-4cc6-b7a3-a2e50f02f173 None None] MFA Rules not processed for user `a5fadc5149a94c71a036fde636d596b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:48.194491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6a8536d4-a7e6-4cc6-b7a3-a2e50f02f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:48.304673 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1197/2418] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:48.830192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:48.833288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:48.858321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e4c7d-f13f-40fa-8d60-fa2853be1f33 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:48.871850 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:48.872531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:48.872740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:48.873017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] PATH_INFO: `/v3/projects/ee12368420364d6d9b9f17823849f96f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:48.875051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee12368420364d6d9b9f17823849f96f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:48.876993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:49.001642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee12368420364d6d9b9f17823849f96f', 'request_id': 'req-e1aad26f-90bb-41ea-bcc6-64dd228dc960'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.013953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee12368420364d6d9b9f17823849f96f', 'request_id': 'req-e1aad26f-90bb-41ea-bcc6-64dd228dc960'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.030898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee12368420364d6d9b9f17823849f96f', 'request_id': 'req-e1aad26f-90bb-41ea-bcc6-64dd228dc960'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.072237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] The token cache is being invalidate because project ee12368420364d6d9b9f17823849f96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:49.073371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.075446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.080046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1222/2419] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:48 2022] DELETE /identity/v3/projects/ee12368420364d6d9b9f17823849f96f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:49.084511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8536d4-a7e6-4cc6-b7a3-a2e50f02f173 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:49.100790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8536d4-a7e6-4cc6-b7a3-a2e50f02f173 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:49.178262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:49.182859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:49.247839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:49.280651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:49.281444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:49.281711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:49.281987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] PATH_INFO: `/v3/users/0129bdfadd6744f3a83d931b305a0450` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:49.283867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0129bdfadd6744f3a83d931b305a0450)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:49.286655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:49.287053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:49.366257 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad26f-90bb-41ea-bcc6-64dd228dc960 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:49.372672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:49.374419 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:49.375198 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:49.376262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] PATH_INFO: `/v3/projects/2e5533d8bda54f10aafa31eab1f430db` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:49.378584 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5533d8bda54f10aafa31eab1f430db)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:49.381808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:49.382002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0129bdfadd6744f3a83d931b305a0450'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.383853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0129bdfadd6744f3a83d931b305a0450'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.387447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0129bdfadd6744f3a83d931b305a0450'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.436036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0129bdfadd6744f3a83d931b305a0450'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.456078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d2c598a4-8b7e-4ab7-9a09-8187a3729933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0129bdfadd6744f3a83d931b305a0450'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.464283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5533d8bda54f10aafa31eab1f430db', 'request_id': 'req-b84d3c4c-da61-431f-81d7-7829a5960930'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.478019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5533d8bda54f10aafa31eab1f430db', 'request_id': 'req-b84d3c4c-da61-431f-81d7-7829a5960930'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.494219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5533d8bda54f10aafa31eab1f430db', 'request_id': 'req-b84d3c4c-da61-431f-81d7-7829a5960930'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.502450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1198/2420] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:49 2022] DELETE /identity/v3/users/0129bdfadd6744f3a83d931b305a0450 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:49.513802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] The token cache is being invalidate because project 2e5533d8bda54f10aafa31eab1f430db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:49.514162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.515134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-b84d3c4c-da61-431f-81d7-7829a5960930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:49.519222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1223/2421] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:49 2022] DELETE /identity/v3/projects/2e5533d8bda54f10aafa31eab1f430db => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:49.522094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe59dc-9735-42ef-9239-bc77a38a3434 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:49.522530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe59dc-9735-42ef-9239-bc77a38a3434 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:49.522916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe59dc-9735-42ef-9239-bc77a38a3434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:49.556095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7afe59dc-9735-42ef-9239-bc77a38a3434 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:49.557929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7afe59dc-9735-42ef-9239-bc77a38a3434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:49.697751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1199/2422] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:49.703900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7d0da-6eda-4701-b1d3-89bba75aba9c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:49.704517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7d0da-6eda-4701-b1d3-89bba75aba9c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:49.705010 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7d0da-6eda-4701-b1d3-89bba75aba9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:49.746677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-bec7d0da-6eda-4701-b1d3-89bba75aba9c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:49.748312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bec7d0da-6eda-4701-b1d3-89bba75aba9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:49.777190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1224/2423] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:30:49.782122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe59dc-9735-42ef-9239-bc77a38a3434 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:49.811681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe59dc-9735-42ef-9239-bc77a38a3434 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:49.831130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:49.832970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:49.834320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:49.834837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:49.835710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:49.836270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:49.838772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:49.862546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1200/2424] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:30:49.866715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7d0da-6eda-4701-b1d3-89bba75aba9c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:49.883984 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7d0da-6eda-4701-b1d3-89bba75aba9c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:49.891925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:49.893248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:49.893248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:49.893813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:49.895049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:49.897078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:49.948382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1225/2425] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:49 2022] POST /identity/v3/projects => generated 397 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:49.955752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:49.974670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880ed70-02b3-43a2-a678-c9584573f14b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:50.079946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:50.110392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:50.111029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:50.111327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:50.111608 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:50.112258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:50.116155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:50.185908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1201/2426] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:49 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:50.190884 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:50.208102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056e2d5-f514-4135-b3bc-6059b284051f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:50.215660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:50.218556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:50.224847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:50.225475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:50.225755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:50.226152 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:50.234100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:50.238450 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:50.245584 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3812e28-8796-48e9-bedb-22d7fb87efa7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:50.267199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:50.269005 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:50.269297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:50.270490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] PATH_INFO: `/v3/projects/6bf939a1f2cc4ba588b725e88980fdc3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:50.272442 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf939a1f2cc4ba588b725e88980fdc3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:50.276985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1226/2427] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:50.281162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:50.285358 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:50.302515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248bf92-03f4-4cc5-8afd-baf55979edb7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:50.313708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:50.314379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:50.314668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:50.314943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:50.315849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:50.317513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:50.344490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1227/2428] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:50.345985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:50.382847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af9a62-a1ee-4c53-a3b3-e77e9b71ab90 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:50.431004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf939a1f2cc4ba588b725e88980fdc3', 'request_id': 'req-7b3693c2-8014-4490-8015-d24d5e789f5c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:50.449862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf939a1f2cc4ba588b725e88980fdc3', 'request_id': 'req-7b3693c2-8014-4490-8015-d24d5e789f5c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:50.461351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf939a1f2cc4ba588b725e88980fdc3', 'request_id': 'req-7b3693c2-8014-4490-8015-d24d5e789f5c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:50.480014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] The token cache is being invalidate because project 6bf939a1f2cc4ba588b725e88980fdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:50.480356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:50.481456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b3693c2-8014-4490-8015-d24d5e789f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:50.484015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1202/2429] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:50 2022] DELETE /identity/v3/projects/6bf939a1f2cc4ba588b725e88980fdc3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:30:50.568311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:50.569547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:50.570034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:50.570553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] PATH_INFO: `/v3/projects/5d6446fbd8384ea4b3c4075e53a0f3c2/users/345613671f1c4b7fbbb3cba991a600b0/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:50.590772 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:50.615101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6446fbd8384ea4b3c4075e53a0f3c2, user_id=345613671f1c4b7fbbb3cba991a600b0, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:50.626553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:50.653397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1228/2430] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:50 2022] PUT /identity/v3/projects/5d6446fbd8384ea4b3c4075e53a0f3c2/users/345613671f1c4b7fbbb3cba991a600b0/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:50.674230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:50.674230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:50.674230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:50.733161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] MFA Rules not processed for user `345613671f1c4b7fbbb3cba991a600b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:50.735006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:50.861838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1203/2431] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:50.875430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:50.880737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:50.996892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaac104-1cd9-42a9-b635-5844f6ff4e90 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:51.002245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c544c-9aba-4cf7-b288-230eaa3bfd30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:51.003140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c544c-9aba-4cf7-b288-230eaa3bfd30 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:51.004522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c544c-9aba-4cf7-b288-230eaa3bfd30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:51.004977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c544c-9aba-4cf7-b288-230eaa3bfd30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:51.024322 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c544c-9aba-4cf7-b288-230eaa3bfd30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:51.026690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c544c-9aba-4cf7-b288-230eaa3bfd30 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:51.051910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1229/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:56.802365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:56.804443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:56.908551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:56.918006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47c964-b38e-429a-b5c1-3012a03b646d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:56.928497 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:56.929316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:56.929698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:56.930144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] PATH_INFO: `/v3/users/345613671f1c4b7fbbb3cba991a600b0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:56.932282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=345613671f1c4b7fbbb3cba991a600b0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:56.934563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:57.006663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345613671f1c4b7fbbb3cba991a600b0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.007521 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345613671f1c4b7fbbb3cba991a600b0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.008299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345613671f1c4b7fbbb3cba991a600b0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.018654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345613671f1c4b7fbbb3cba991a600b0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.027365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345613671f1c4b7fbbb3cba991a600b0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.050842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1204/2433] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:30:56 2022] DELETE /identity/v3/users/345613671f1c4b7fbbb3cba991a600b0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:57.052527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.053018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.053120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.075374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:57.076642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:57.149630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1230/2434] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:57.159920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:57.161303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:57.222162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7697b-036c-4778-942c-3341ff86d21c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:57.226159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38fd8d-0292-4cc0-968d-b09b5bf7d9ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:57.226884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fd8d-0292-4cc0-968d-b09b5bf7d9ea service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.227163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fd8d-0292-4cc0-968d-b09b5bf7d9ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.227431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fd8d-0292-4cc0-968d-b09b5bf7d9ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.236776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38fd8d-0292-4cc0-968d-b09b5bf7d9ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:57.238229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38fd8d-0292-4cc0-968d-b09b5bf7d9ea service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:57.248686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1205/2435] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:30:57.519012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:57.520825 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:57.544403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5109cd9-8954-499d-857f-8fb0f1c6123e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:57.550208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:57.550840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.551117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.551382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] PATH_INFO: `/v3/projects/5d6446fbd8384ea4b3c4075e53a0f3c2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.553296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6446fbd8384ea4b3c4075e53a0f3c2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:57.554811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:57.612911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6446fbd8384ea4b3c4075e53a0f3c2', 'request_id': 'req-92637963-df90-4905-9b9a-a5eecec290a3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.619446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6446fbd8384ea4b3c4075e53a0f3c2', 'request_id': 'req-92637963-df90-4905-9b9a-a5eecec290a3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.627497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6446fbd8384ea4b3c4075e53a0f3c2', 'request_id': 'req-92637963-df90-4905-9b9a-a5eecec290a3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.637940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] The token cache is being invalidate because project 5d6446fbd8384ea4b3c4075e53a0f3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:30:57.638256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.639312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92637963-df90-4905-9b9a-a5eecec290a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:30:57.640794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1231/2436] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:30:57 2022] DELETE /identity/v3/projects/5d6446fbd8384ea4b3c4075e53a0f3c2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:30:57.645975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cdf6-904f-4ab6-b688-9a5781c18c40 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.646298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cdf6-904f-4ab6-b688-9a5781c18c40 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.646575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cdf6-904f-4ab6-b688-9a5781c18c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.665596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f154cdf6-904f-4ab6-b688-9a5781c18c40 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:57.666835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f154cdf6-904f-4ab6-b688-9a5781c18c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:57.727815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1206/2437] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:57.736127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd37b8c-625d-4f96-a28a-e11bc04327e9 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.736413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd37b8c-625d-4f96-a28a-e11bc04327e9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.736690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd37b8c-625d-4f96-a28a-e11bc04327e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.756636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-afd37b8c-625d-4f96-a28a-e11bc04327e9 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:57.757830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-afd37b8c-625d-4f96-a28a-e11bc04327e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:57.765910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1232/2438] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:57.770107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cdf6-904f-4ab6-b688-9a5781c18c40 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:57.779784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cdf6-904f-4ab6-b688-9a5781c18c40 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:57.784327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:57.784917 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.785197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.785472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.786143 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:30:57.786448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:57.788054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:57.800874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1207/2439] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:30:57.805100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd37b8c-625d-4f96-a28a-e11bc04327e9 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:57.815241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd37b8c-625d-4f96-a28a-e11bc04327e9 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:57.819889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:57.820560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.820838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.821105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.821736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:57.823666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:57.828921 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:57.858693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1233/2440] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:30:57 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:30:57.860042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:57.869048 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:30:57.873346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb3a76-5937-4355-8bf6-4b8ba0953010 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:57.936428 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:57.937058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.937386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.937764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.938459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:57.940378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:57.963720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1208/2441] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:30:57 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:30:57.968183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:57.979685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fb8e4-553a-49d3-862d-9001e026ec9d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:57.987093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:57.987698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:57.987974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:57.988506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:57.989140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:57.991192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:58.003182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1234/2442] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:30:58.007024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:58.019475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b76ab-4909-41a4-8d3f-8c2a97478058 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:58.024086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2553422-56de-45f0-b112-cdb7dc97929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:58.025106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2553422-56de-45f0-b112-cdb7dc97929a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:58.025495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2553422-56de-45f0-b112-cdb7dc97929a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:58.025860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2553422-56de-45f0-b112-cdb7dc97929a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:58.026640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2553422-56de-45f0-b112-cdb7dc97929a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:58.028385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2553422-56de-45f0-b112-cdb7dc97929a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:58.041849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1209/2443] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:30:58.046706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:58.073646 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba34d5-82d4-4574-a993-dbfba0c2de5c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:58.079155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:58.079953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:58.080347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:58.080721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] PATH_INFO: `/v3/projects/0d1d69075ff34a78acf94a53ea1862c5/users/d02f0f303c874245aeb20a555e3ae8d6/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:58.101223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1d69075ff34a78acf94a53ea1862c5, user_id=d02f0f303c874245aeb20a555e3ae8d6, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:58.105146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:58.123353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1235/2444] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:30:58 2022] PUT /identity/v3/projects/0d1d69075ff34a78acf94a53ea1862c5/users/d02f0f303c874245aeb20a555e3ae8d6/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:30:58.128744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a379-55e6-47d7-87aa-670a9e2a5c50 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:58.129593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a379-55e6-47d7-87aa-670a9e2a5c50 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:58.129876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a379-55e6-47d7-87aa-670a9e2a5c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:58.152567 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-db15a379-55e6-47d7-87aa-670a9e2a5c50 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:30:58.153821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-db15a379-55e6-47d7-87aa-670a9e2a5c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:58.231763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1210/2445] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:30:58.243085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:30:58.244863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:30:58.304400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f0e21-b15c-4a72-b3d9-10ecb22f1ed7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:30:58.308047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e41052-8ea1-4b5c-b9f3-f6326c976b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:30:58.308647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41052-8ea1-4b5c-b9f3-f6326c976b66 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:30:58.308927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41052-8ea1-4b5c-b9f3-f6326c976b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:30:58.309215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e41052-8ea1-4b5c-b9f3-f6326c976b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:30:58.318961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41052-8ea1-4b5c-b9f3-f6326c976b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:30:58.320439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e41052-8ea1-4b5c-b9f3-f6326c976b66 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:30:58.331723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1236/2446] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:31:01.559344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f9c1-a8b1-4c22-9b83-af682852e4e5 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:01.562438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f9c1-a8b1-4c22-9b83-af682852e4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:01.563055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18f9c1-a8b1-4c22-9b83-af682852e4e5 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:01.565520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1211/2447] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:31:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:31:01.573544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d957-4358-4e52-bb36-36022a318457 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:01.574580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d957-4358-4e52-bb36-36022a318457 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:01.576418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60d957-4358-4e52-bb36-36022a318457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:01.599118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8e60d957-4358-4e52-bb36-36022a318457 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:01.600676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8e60d957-4358-4e52-bb36-36022a318457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:01.683178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1237/2448] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:31:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:31:01.697815 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18f9c1-a8b1-4c22-9b83-af682852e4e5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:01.699741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1d18f9c1-a8b1-4c22-9b83-af682852e4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:01.776381 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18f9c1-a8b1-4c22-9b83-af682852e4e5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:01.781926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26574c5-a4f2-4c07-832d-41c021a20bb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5190ae783a4c89b51797729aaaa6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:01.782708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26574c5-a4f2-4c07-832d-41c021a20bb4 service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:01.783010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26574c5-a4f2-4c07-832d-41c021a20bb4 service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:01.783272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26574c5-a4f2-4c07-832d-41c021a20bb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:01.812100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26574c5-a4f2-4c07-832d-41c021a20bb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:01.814471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26574c5-a4f2-4c07-832d-41c021a20bb4 service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:01.846864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1212/2449] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:31:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:31:01.942293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff8b8-54d3-49d7-8bb2-5c71502939f5 None None] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:01.942504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff8b8-54d3-49d7-8bb2-5c71502939f5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:01.942759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eff8b8-54d3-49d7-8bb2-5c71502939f5 None None] PATH_INFO: `/` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:01.944381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1238/2450] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:31:01.949472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5ac2-1921-431a-8b29-1695ad0ec490 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:01.949757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5ac2-1921-431a-8b29-1695ad0ec490 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:01.950078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5ac2-1921-431a-8b29-1695ad0ec490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:01.978664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b8cb5ac2-1921-431a-8b29-1695ad0ec490 None None] MFA Rules not processed for user `38287d3f91704657bc26c5b4d50c0315`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:01.980021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8cb5ac2-1921-431a-8b29-1695ad0ec490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:01.992361 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1213/2451] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:31:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:31:02.008598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff8b8-54d3-49d7-8bb2-5c71502939f5 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:02.010508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-84eff8b8-54d3-49d7-8bb2-5c71502939f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:02.028128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eff8b8-54d3-49d7-8bb2-5c71502939f5 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:02.032247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b7a4f-7e3c-4e92-8e30-bc370b95649a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:02.032823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b7a4f-7e3c-4e92-8e30-bc370b95649a service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:02.033101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b7a4f-7e3c-4e92-8e30-bc370b95649a service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:02.033371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b7a4f-7e3c-4e92-8e30-bc370b95649a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:02.040978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b7a4f-7e3c-4e92-8e30-bc370b95649a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:02.042627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b7a4f-7e3c-4e92-8e30-bc370b95649a service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:02.086090 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1239/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:31:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:31:02.190526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf9fe-6adc-4361-b752-bdaf465650b2 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:02.190811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf9fe-6adc-4361-b752-bdaf465650b2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:02.191086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf9fe-6adc-4361-b752-bdaf465650b2 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:02.192960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1214/2453] 10.222.0.18 () {54 vars in 921 bytes} [Fri Sep 30 19:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:31:02.198582 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472917c9-45d1-4d4f-8086-372980e20934 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:02.199387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472917c9-45d1-4d4f-8086-372980e20934 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:02.199986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472917c9-45d1-4d4f-8086-372980e20934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:02.227129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-472917c9-45d1-4d4f-8086-372980e20934 None None] MFA Rules not processed for user `57667fb21646457b8871087abcbd978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:02.228970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-472917c9-45d1-4d4f-8086-372980e20934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:02.243934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1240/2454] 10.222.0.18 () {58 vars in 1018 bytes} [Fri Sep 30 19:31:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:31:02.254434 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf9fe-6adc-4361-b752-bdaf465650b2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:02.276353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf9fe-6adc-4361-b752-bdaf465650b2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:02.283227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:02.284221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:02.285121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:02.285581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:02.303016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:02.304805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:02.319637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1215/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:31:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:31:03.604511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504933c-a67a-427b-a7af-fac081a9aeeb None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:03.604970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504933c-a67a-427b-a7af-fac081a9aeeb None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:03.605188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504933c-a67a-427b-a7af-fac081a9aeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:03.636437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8504933c-a67a-427b-a7af-fac081a9aeeb None None] MFA Rules not processed for user `d02f0f303c874245aeb20a555e3ae8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:03.639065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8504933c-a67a-427b-a7af-fac081a9aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:03.651708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:03.725353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1241/2456] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:31:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:31:03.729816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:03.742858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16520ef9-46d3-4f2e-9f5f-f099d691811b service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:03.748131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:03.748837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:03.749082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:03.749476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:03.750269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:03.752500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:03.757088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:03.815382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1216/2457] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:31:03 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:31:03.819924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504933c-a67a-427b-a7af-fac081a9aeeb None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:03.834947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504933c-a67a-427b-a7af-fac081a9aeeb None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:03.897576 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:03.898464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:03.899197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:03.899673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:03.900517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:03.902524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:03.938374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1242/2458] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:31:03 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:31:03.938671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:03.968193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d876fe-fb45-43af-ad50-e4d12bc127d2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:03.978114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:03.979242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:03.979646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:03.982503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:03.983178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:03.984849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:03.996795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1217/2459] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:31:04.001686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:04.016944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e120dfd-c2a0-4ae0-94f3-c9ee2b6e3f1d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:04.032974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:04.033666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:04.033953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:04.036176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] PATH_INFO: `/v3/projects/e76cee7d84ff4eeb8f9f73d371dc89ac/users/f172237ea2194184bf7b1784e2039475/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:04.055228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76cee7d84ff4eeb8f9f73d371dc89ac, user_id=f172237ea2194184bf7b1784e2039475, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:04.058129 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:04.080945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1243/2460] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:31:04 2022] PUT /identity/v3/projects/e76cee7d84ff4eeb8f9f73d371dc89ac/users/f172237ea2194184bf7b1784e2039475/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:31:04.085023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:04.096461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cc294-b087-46b2-831b-f8aa04df7098 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:04.173355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeb693-05e4-47b7-b7f0-5b560f18ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:04.173969 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb693-05e4-47b7-b7f0-5b560f18ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:04.174284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb693-05e4-47b7-b7f0-5b560f18ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:04.174558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeb693-05e4-47b7-b7f0-5b560f18ada5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:04.175207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeb693-05e4-47b7-b7f0-5b560f18ada5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:04.176856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeb693-05e4-47b7-b7f0-5b560f18ada5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:04.188818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1218/2461] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:31:04.192562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:04.206209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95925ef-666f-48a2-b407-12daee7bd40e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:04.210854 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:04.211948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:04.212299 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:04.212647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] PATH_INFO: `/v3/projects/e76cee7d84ff4eeb8f9f73d371dc89ac/users/f172237ea2194184bf7b1784e2039475/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:04.214887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76cee7d84ff4eeb8f9f73d371dc89ac, user_id=f172237ea2194184bf7b1784e2039475, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:04.219103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:04.230990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1244/2462] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:31:04 2022] PUT /identity/v3/projects/e76cee7d84ff4eeb8f9f73d371dc89ac/users/f172237ea2194184bf7b1784e2039475/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:31:05.953367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0912-1a3e-4aef-91de-a812893960ca None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:05.953919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0912-1a3e-4aef-91de-a812893960ca None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:05.953919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0912-1a3e-4aef-91de-a812893960ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:05.998908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-605a0912-1a3e-4aef-91de-a812893960ca None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:06.000352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-605a0912-1a3e-4aef-91de-a812893960ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:06.155624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1219/2463] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:31:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:31:06.171019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:06.173433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:06.329327 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59dab4-e7a4-4a16-9d3d-f8aebc63d551 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:06.335256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:06.335821 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:06.336161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:06.336621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:06.347719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:06.355060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:06.357762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:06.371267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1245/2464] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:31:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:31:10.892160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfaa69-1df1-4f9f-ae91-f67297f0e515 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:10.892729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfaa69-1df1-4f9f-ae91-f67297f0e515 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:10.892729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfaa69-1df1-4f9f-ae91-f67297f0e515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:10.938257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b0dfaa69-1df1-4f9f-ae91-f67297f0e515 None None] MFA Rules not processed for user `f172237ea2194184bf7b1784e2039475`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:10.939717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b0dfaa69-1df1-4f9f-ae91-f67297f0e515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:11.070431 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:11.082590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1220/2465] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:31:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:31:11.096064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:11.243805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484077f-498a-48e7-b1dd-da83fc782fc2 service swift] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:11.253871 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5190ae783a4c89b51797729aaaa6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:11.254716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:11.254999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:11.255267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:11.411740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:11.413848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:11.430254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1246/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:31:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:31:11.659691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d188-e3f5-43f5-b8d7-973d442ad719 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:11.660389 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d188-e3f5-43f5-b8d7-973d442ad719 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:11.660884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d188-e3f5-43f5-b8d7-973d442ad719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:11.697848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dd03d188-e3f5-43f5-b8d7-973d442ad719 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:11.704546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dd03d188-e3f5-43f5-b8d7-973d442ad719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:11.719234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1221/2467] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:31:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:31:11.738606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:11.755844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fcdb1-72ed-4c42-b8ea-e14c3f71eb5e service glance] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:11.761573 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d64ac-7e27-4fc9-94ac-4957ea35dbdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:11.763125 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d64ac-7e27-4fc9-94ac-4957ea35dbdd service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:11.763475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d64ac-7e27-4fc9-94ac-4957ea35dbdd service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:11.763747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d64ac-7e27-4fc9-94ac-4957ea35dbdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:11.783981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d64ac-7e27-4fc9-94ac-4957ea35dbdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:11.785663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d64ac-7e27-4fc9-94ac-4957ea35dbdd service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:11.802739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1247/2468] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:31:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:31:21.691492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:21.798393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=56 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:22.547245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0fe49-4ecc-4a35-8d57-55f12a452423 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:22.547643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0fe49-4ecc-4a35-8d57-55f12a452423 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:22.547801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0fe49-4ecc-4a35-8d57-55f12a452423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:22.566339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-43b0fe49-4ecc-4a35-8d57-55f12a452423 None None] MFA Rules not processed for user `d02f0f303c874245aeb20a555e3ae8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:22.567533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-43b0fe49-4ecc-4a35-8d57-55f12a452423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:22.575010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1222/2469] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:31:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:31:25.079851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7b08-3466-4ab0-bef3-84b77192a88a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:25.080288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7b08-3466-4ab0-bef3-84b77192a88a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:25.080410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7b08-3466-4ab0-bef3-84b77192a88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:25.099992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a5dd7b08-3466-4ab0-bef3-84b77192a88a None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:25.101115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a5dd7b08-3466-4ab0-bef3-84b77192a88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:25.109042 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1248/2470] 10.222.0.18 () {58 vars in 967 bytes} [Fri Sep 30 19:31:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:31:25.122191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0fe49-4ecc-4a35-8d57-55f12a452423 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:25.133881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0fe49-4ecc-4a35-8d57-55f12a452423 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:25.138998 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:25.139591 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:25.139876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:25.140149 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:25.148058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:25.149623 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:25.158366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1223/2471] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:31:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:31:25.763742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:25.764121 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:25.764490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:25.784987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:31:25.786669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:25.802500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1249/2472] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:31:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:31:25.811736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:25.824043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ae9f-074e-4e69-a188-c96be3408fa6 service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:25.830668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:25.831462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:25.832296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:25.832756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:25.844377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:25.846217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:25.854541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1224/2473] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:31:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 30 19:31:35.779349 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=6 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:35.851243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=15 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:36.289615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:36.291665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:36.380250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8bfed-6f9c-46bb-af34-e3d6d3f3e041 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:36.386195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b83ca4-8d69-40ab-b079-c9f3d6471ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:36.386694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83ca4-8d69-40ab-b079-c9f3d6471ad9 service placement] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:36.386967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83ca4-8d69-40ab-b079-c9f3d6471ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:36.387795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b83ca4-8d69-40ab-b079-c9f3d6471ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:36.391515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b5b83ca4-8d69-40ab-b079-c9f3d6471ad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:31:36.405059 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b83ca4-8d69-40ab-b079-c9f3d6471ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:36.406946 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b83ca4-8d69-40ab-b079-c9f3d6471ad9 service placement] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:36.417709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1250/2474] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:31:46.412947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=32 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:31:51.988315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:31:52.056140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89119-10ef-4147-9d81-2d20891fba17 service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:31:52.061023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffcddb-7d84-40d1-920c-19bc388f7bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:31:52.061632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffcddb-7d84-40d1-920c-19bc388f7bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:31:52.061906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffcddb-7d84-40d1-920c-19bc388f7bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:31:52.062205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffcddb-7d84-40d1-920c-19bc388f7bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:31:52.071828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffcddb-7d84-40d1-920c-19bc388f7bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:31:52.073400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffcddb-7d84-40d1-920c-19bc388f7bc0 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:31:52.083698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1225/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:31:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:32:00.290600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28043c0-d230-4097-bb56-21ad10d3e641 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:32:00.291088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28043c0-d230-4097-bb56-21ad10d3e641 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:32:00.291207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28043c0-d230-4097-bb56-21ad10d3e641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:32:00.311014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b28043c0-d230-4097-bb56-21ad10d3e641 None None] MFA Rules not processed for user `a5fadc5149a94c71a036fde636d596b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:32:00.312208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b28043c0-d230-4097-bb56-21ad10d3e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:32:00.366553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1251/2476] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:32:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:32:02.079436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=26 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:10.359976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=25 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:14.860911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:32:14.861418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:32:14.861520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:32:14.881186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] MFA Rules not processed for user `74754bc2aec247f596c7f7317e0dc7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:32:14.882414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:32:14.936273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1226/2477] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:32:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:32:24.929092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=25 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:32:25.949651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f35e6-0ad1-44e9-ba50-473dca2503ef None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:32:25.949651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f35e6-0ad1-44e9-ba50-473dca2503ef None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:32:25.950309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f35e6-0ad1-44e9-ba50-473dca2503ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:32:25.970674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-217f35e6-0ad1-44e9-ba50-473dca2503ef None None] MFA Rules not processed for user `b4522da7ad4f4620b27e0c0006c520d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:32:25.971952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-217f35e6-0ad1-44e9-ba50-473dca2503ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:32:26.030815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1252/2478] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:32:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:32:36.023225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=25 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:10.502223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:10.503655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:10.568668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f21de-144e-41f8-a517-a1c7f4530ad0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:10.574472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:10.575089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:10.575366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:10.575637 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] PATH_INFO: `/v3/users/a5fadc5149a94c71a036fde636d596b1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:10.576734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fadc5149a94c71a036fde636d596b1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:10.578659 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:10.624039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fadc5149a94c71a036fde636d596b1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.624703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fadc5149a94c71a036fde636d596b1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.625281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fadc5149a94c71a036fde636d596b1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.632260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fadc5149a94c71a036fde636d596b1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.640091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-221ae953-9f18-4330-a3d3-2f300e99614d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fadc5149a94c71a036fde636d596b1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.657124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1227/2479] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:33:10 2022] DELETE /identity/v3/users/a5fadc5149a94c71a036fde636d596b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:10.835807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f35e6-0ad1-44e9-ba50-473dca2503ef None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:10.848532 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f35e6-0ad1-44e9-ba50-473dca2503ef None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:10.907108 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:10.907781 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:10.908001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:10.908270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] PATH_INFO: `/v3/projects/b31689c5d1f44d798f5add324c9e0759` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:10.909354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31689c5d1f44d798f5add324c9e0759)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:10.911330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:10.958570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31689c5d1f44d798f5add324c9e0759', 'request_id': 'req-4176f027-cd96-47f3-a4aa-58f42891d269'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.964670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31689c5d1f44d798f5add324c9e0759', 'request_id': 'req-4176f027-cd96-47f3-a4aa-58f42891d269'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.971909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31689c5d1f44d798f5add324c9e0759', 'request_id': 'req-4176f027-cd96-47f3-a4aa-58f42891d269'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.983103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] The token cache is being invalidate because project b31689c5d1f44d798f5add324c9e0759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:33:10.983393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.984030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4176f027-cd96-47f3-a4aa-58f42891d269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:10.985497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1253/2480] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:33:10 2022] DELETE /identity/v3/projects/b31689c5d1f44d798f5add324c9e0759 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:10.990482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5f079-79e5-45ae-8c89-4b8d14dab78a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:10.990769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5f079-79e5-45ae-8c89-4b8d14dab78a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:10.991045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5f079-79e5-45ae-8c89-4b8d14dab78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.011179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f9c5f079-79e5-45ae-8c89-4b8d14dab78a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:11.012360 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f9c5f079-79e5-45ae-8c89-4b8d14dab78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:11.074561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1228/2481] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:33:11.082310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a144-e134-41c6-8688-ff03f62cb4d9 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.082587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a144-e134-41c6-8688-ff03f62cb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.082863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a144-e134-41c6-8688-ff03f62cb4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.103512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1dc9a144-e134-41c6-8688-ff03f62cb4d9 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:11.104721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1dc9a144-e134-41c6-8688-ff03f62cb4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:11.112690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1254/2482] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:11.116832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5f079-79e5-45ae-8c89-4b8d14dab78a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:11.127059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5f079-79e5-45ae-8c89-4b8d14dab78a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:11.131555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:11.132139 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.132413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.132681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.133328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:33:11.133602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:11.135199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:11.146493 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1229/2483] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:33:11.151156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9a144-e134-41c6-8688-ff03f62cb4d9 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:11.160324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9a144-e134-41c6-8688-ff03f62cb4d9 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:11.164842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:11.165456 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.165731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.165999 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.167173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:11.170242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:11.206740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1255/2484] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:33:11 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:33:11.208321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:11.222636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71697bce-c87b-4cae-86ef-8d7a094bf735 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:11.226388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:11.294256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:11.294959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.295302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.295635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.296342 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:11.298347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:11.323958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1230/2485] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:33:11 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:33:11.328131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:11.338863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5c0ea-74c5-45a7-bbe0-7f3787be3176 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:11.344018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:11.344618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.344893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.345162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.345799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:11.347435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:11.358398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1256/2486] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:33:11.362298 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:11.373180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9bf98-b55d-4d2f-a326-6eb800ef3d4a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:11.377865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e004d-a80c-4a20-8de0-3e282d4af554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:11.378498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e004d-a80c-4a20-8de0-3e282d4af554 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.378780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e004d-a80c-4a20-8de0-3e282d4af554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.379055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e004d-a80c-4a20-8de0-3e282d4af554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.379994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e004d-a80c-4a20-8de0-3e282d4af554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:11.381876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e004d-a80c-4a20-8de0-3e282d4af554 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:11.392669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1231/2487] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:33:11.396828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:11.406699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594aeb6-67d5-4410-814b-361dc6893013 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:11.411339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:11.411917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.412194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.412463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] PATH_INFO: `/v3/projects/05880f6406324dc39d4dcff2e6904a55/users/7a28576fcbc34c0f9dda76e8b390928a/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.427422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=05880f6406324dc39d4dcff2e6904a55, user_id=7a28576fcbc34c0f9dda76e8b390928a, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:11.430062 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:11.443071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1257/2488] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:33:11 2022] PUT /identity/v3/projects/05880f6406324dc39d4dcff2e6904a55/users/7a28576fcbc34c0f9dda76e8b390928a/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:11.448392 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239f92-677f-4cf7-a661-7deed990df8f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.448685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239f92-677f-4cf7-a661-7deed990df8f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.448960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239f92-677f-4cf7-a661-7deed990df8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.468033 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ed239f92-677f-4cf7-a661-7deed990df8f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:11.469269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ed239f92-677f-4cf7-a661-7deed990df8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:11.527881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1232/2489] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:11.537398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:11.539127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:11.570366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:11.598379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cdec4-17ee-4238-aa46-0030fea3fe2c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:11.602037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:11.602660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:11.602938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:11.603208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:11.612815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:11.614276 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:11.623618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1258/2490] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:15.996558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea6b6d-6b71-42f6-832a-edf20148f07d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:15.997144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea6b6d-6b71-42f6-832a-edf20148f07d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:15.997144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea6b6d-6b71-42f6-832a-edf20148f07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:16.025964 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-13ea6b6d-6b71-42f6-832a-edf20148f07d None None] MFA Rules not processed for user `7a28576fcbc34c0f9dda76e8b390928a`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:16.027226 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-13ea6b6d-6b71-42f6-832a-edf20148f07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:16.106959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1233/2491] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:16.121833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:16.123394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:16.215689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7917e8-6327-43ea-b8a6-bb190ccb87bd service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:16.224613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:16.225307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:16.225657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:16.226001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:16.235978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:16.237755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:16.247847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1259/2492] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:17.776395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b66f3-2a2d-4fbe-8f0c-83cb63d798a3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:17.776918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b66f3-2a2d-4fbe-8f0c-83cb63d798a3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:17.777023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b66f3-2a2d-4fbe-8f0c-83cb63d798a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:17.799542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5e1b66f3-2a2d-4fbe-8f0c-83cb63d798a3 None None] MFA Rules not processed for user `7a28576fcbc34c0f9dda76e8b390928a`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:17.800842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5e1b66f3-2a2d-4fbe-8f0c-83cb63d798a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:17.809223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1234/2493] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:25.083480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:25.084858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:25.141099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70df47b-e2d2-4ef9-a299-a356ebdb2a83 service nova] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:25.144736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:25.145329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:25.145604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:25.145872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:25.147598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:25.161354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:25.162812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:25.173521 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1260/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:27.238862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b66f3-2a2d-4fbe-8f0c-83cb63d798a3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:27.248612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b66f3-2a2d-4fbe-8f0c-83cb63d798a3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:27.252101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e6e6-f602-489c-8621-7e569158c4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:27.252690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e6e6-f602-489c-8621-7e569158c4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:27.252966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e6e6-f602-489c-8621-7e569158c4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:27.253234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e6e6-f602-489c-8621-7e569158c4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:27.254953 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2753e6e6-f602-489c-8621-7e569158c4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:27.265936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:27.268301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753e6e6-f602-489c-8621-7e569158c4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:27.270250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753e6e6-f602-489c-8621-7e569158c4d7 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:27.281959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1235/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:35.168762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=74 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:37.071144 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:37.072635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:37.086952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee5a67-2889-4200-86db-0a27bdbdfcd1 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:37.092423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:37.093019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:37.093293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:37.093567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:37.095508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:37.163899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:37.165810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:37.175036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1261/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:37.277338 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:39.414207 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f8d0-8c45-44c3-b7db-8aba1250d13c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:39.414819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f8d0-8c45-44c3-b7db-8aba1250d13c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:39.414819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7f8d0-8c45-44c3-b7db-8aba1250d13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:39.434844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e0e7f8d0-8c45-44c3-b7db-8aba1250d13c None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:39.436089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e0e7f8d0-8c45-44c3-b7db-8aba1250d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:39.493352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1236/2497] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:33:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:39.539844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:39.541555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:39.634861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78482a5f-4067-436c-a19c-ca7b3c194f34 service nova] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:39.640089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:39.640701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:39.640983 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:39.641260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:39.651817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:39.653459 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:39.669847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1262/2498] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:33:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:33:41.643911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:41.644536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:41.644536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:41.681942 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:41.683868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:41.696952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1237/2499] 10.222.0.18 () {58 vars in 967 bytes} [Fri Sep 30 19:33:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:41.720431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:41.734452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e7c9-8304-484d-9538-c85ebd9f26be service swift] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:41.743641 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:41.744323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:41.744763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:41.745207 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:41.754754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:41.756759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:41.781154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1263/2500] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:33:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:33:43.137589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:43.140377 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:43.154347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029bdc2-e25e-464d-8eab-73642c82af19 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:43.158420 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:43.159833 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:43.161156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:43.161834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:43.164545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:43.250332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:43.251987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:43.271198 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1238/2501] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:47.756673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:47.770226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d321b0-6f1f-42cf-9d73-28e1c2c7875f service swift] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:47.774615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:47.775238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:47.775518 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:47.775808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:47.779483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:47.796210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:47.797820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:47.828399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1264/2502] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:51.079629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:51.081036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:51.192575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:51.194007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:51.208917 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4528a4-5867-4122-8a4b-1742e6786989 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:51.222967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:51.223551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:51.223828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:51.224099 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] PATH_INFO: `/v3/users/d02f0f303c874245aeb20a555e3ae8d6` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:51.228878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02f0f303c874245aeb20a555e3ae8d6)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:51.231998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:51.252589 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fae05-d2ba-43fd-9fa4-36ccaafbc602 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:51.275789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:51.276622 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:51.276910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:51.277179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:51.283486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:51.319345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:51.327407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:51.355373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1239/2503] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:33:51.373442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02f0f303c874245aeb20a555e3ae8d6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:51.389313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02f0f303c874245aeb20a555e3ae8d6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:51.390479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02f0f303c874245aeb20a555e3ae8d6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:51.394439 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:51.409155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02f0f303c874245aeb20a555e3ae8d6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:51.414653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02f0f303c874245aeb20a555e3ae8d6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:51.445787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1265/2504] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:33:51 2022] DELETE /identity/v3/users/d02f0f303c874245aeb20a555e3ae8d6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:51.720319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:51.735271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53aa80-a72c-4d59-9edc-00c28c2535ed service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:51.800919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:51.895084 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:51.896418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:51.896418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:51.896418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] PATH_INFO: `/v3/projects/0d1d69075ff34a78acf94a53ea1862c5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:51.898275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1d69075ff34a78acf94a53ea1862c5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:51.901007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:51.977315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1d69075ff34a78acf94a53ea1862c5', 'request_id': 'req-f63dece4-2f2a-4545-8ba4-3a9620b75818'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:51.993600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1d69075ff34a78acf94a53ea1862c5', 'request_id': 'req-f63dece4-2f2a-4545-8ba4-3a9620b75818'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.002140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1d69075ff34a78acf94a53ea1862c5', 'request_id': 'req-f63dece4-2f2a-4545-8ba4-3a9620b75818'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.027824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] The token cache is being invalidate because project 0d1d69075ff34a78acf94a53ea1862c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:33:52.028373 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.029235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.031910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1240/2505] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:33:51 2022] DELETE /identity/v3/projects/0d1d69075ff34a78acf94a53ea1862c5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:52.035897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:52.037451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:52.075003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa423f67-9d5b-4ed7-810e-a8e7a76a97dc admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:52.165861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:52.166721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:52.167011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:52.167291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] PATH_INFO: `/v3/users/f172237ea2194184bf7b1784e2039475` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:52.168709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f172237ea2194184bf7b1784e2039475)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:52.171086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:52.242660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f172237ea2194184bf7b1784e2039475'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.254619 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f172237ea2194184bf7b1784e2039475'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.255874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f172237ea2194184bf7b1784e2039475'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.270272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f172237ea2194184bf7b1784e2039475'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.271989 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f172237ea2194184bf7b1784e2039475'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.318331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1266/2506] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:33:52 2022] DELETE /identity/v3/users/f172237ea2194184bf7b1784e2039475 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:52.676386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:52.679435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:52.708793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dece4-2f2a-4545-8ba4-3a9620b75818 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:52.855010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:52.856170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:52.856744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:52.857378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] PATH_INFO: `/v3/projects/e76cee7d84ff4eeb8f9f73d371dc89ac` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:52.875897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76cee7d84ff4eeb8f9f73d371dc89ac)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:52.881250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:52.973601 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76cee7d84ff4eeb8f9f73d371dc89ac', 'request_id': 'req-d5ce430c-bf31-451a-a78b-40e3d377cc3f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.983171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76cee7d84ff4eeb8f9f73d371dc89ac', 'request_id': 'req-d5ce430c-bf31-451a-a78b-40e3d377cc3f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:52.986910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:52.994546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76cee7d84ff4eeb8f9f73d371dc89ac', 'request_id': 'req-d5ce430c-bf31-451a-a78b-40e3d377cc3f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.011029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] The token cache is being invalidate because project e76cee7d84ff4eeb8f9f73d371dc89ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:33:53.011404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.012454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.034391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1241/2507] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:33:52 2022] DELETE /identity/v3/projects/e76cee7d84ff4eeb8f9f73d371dc89ac => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:53.107746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:53.109711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:53.129672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d97bf-0c59-473e-9278-ee9e321ab711 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:53.223919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:53.238398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:53.239452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:53.240056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:53.240482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] PATH_INFO: `/v3/users/b4522da7ad4f4620b27e0c0006c520d0` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:53.242521 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4522da7ad4f4620b27e0c0006c520d0)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:53.245691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:53.317069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4522da7ad4f4620b27e0c0006c520d0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.327815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4522da7ad4f4620b27e0c0006c520d0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.328539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4522da7ad4f4620b27e0c0006c520d0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.336705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4522da7ad4f4620b27e0c0006c520d0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.337516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-afd905e3-9cd5-4b99-9143-a131b9ba6430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4522da7ad4f4620b27e0c0006c520d0'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.357935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1267/2508] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:33:53 2022] DELETE /identity/v3/users/b4522da7ad4f4620b27e0c0006c520d0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:53.537089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:53.539094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:53.552777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce430c-bf31-451a-a78b-40e3d377cc3f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:53.616577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:53.617220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:53.617501 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:53.617773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] PATH_INFO: `/v3/projects/45abf5a3455c4a2a8ffbbd5499c97181` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:53.618923 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45abf5a3455c4a2a8ffbbd5499c97181)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:53.620809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:53.667901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45abf5a3455c4a2a8ffbbd5499c97181', 'request_id': 'req-31e91279-e494-4dbe-b915-59756996e3d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.674993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45abf5a3455c4a2a8ffbbd5499c97181', 'request_id': 'req-31e91279-e494-4dbe-b915-59756996e3d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.681531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45abf5a3455c4a2a8ffbbd5499c97181', 'request_id': 'req-31e91279-e494-4dbe-b915-59756996e3d2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.693534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] The token cache is being invalidate because project 45abf5a3455c4a2a8ffbbd5499c97181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:33:53.693823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.695228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31e91279-e494-4dbe-b915-59756996e3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:53.696861 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1242/2509] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:33:53 2022] DELETE /identity/v3/projects/45abf5a3455c4a2a8ffbbd5499c97181 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:53.701747 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb966a1-f0c0-4b33-9da7-385bfd5c568c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:53.702158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb966a1-f0c0-4b33-9da7-385bfd5c568c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:53.702499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb966a1-f0c0-4b33-9da7-385bfd5c568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:53.722748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-3cb966a1-f0c0-4b33-9da7-385bfd5c568c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:53.723905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-3cb966a1-f0c0-4b33-9da7-385bfd5c568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:53.783527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1268/2510] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:53.791561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2a0a8-ef94-4b74-bfff-b160d8e0da26 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:53.791846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2a0a8-ef94-4b74-bfff-b160d8e0da26 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:53.792121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2a0a8-ef94-4b74-bfff-b160d8e0da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:53.811950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-43c2a0a8-ef94-4b74-bfff-b160d8e0da26 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:53.813185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-43c2a0a8-ef94-4b74-bfff-b160d8e0da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:53.822337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1243/2511] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:53.826508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb966a1-f0c0-4b33-9da7-385bfd5c568c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:53.837587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb966a1-f0c0-4b33-9da7-385bfd5c568c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:53.842658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:53.843527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:53.843803 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:53.844070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:53.844719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:33:53.845025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:53.846638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:53.863797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1269/2512] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:33:53.865224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2a0a8-ef94-4b74-bfff-b160d8e0da26 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:53.875685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2a0a8-ef94-4b74-bfff-b160d8e0da26 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:53.880606 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:53.881211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:53.882038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:53.882409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:53.883041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:53.884965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:53.913560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1244/2513] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:33:53 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:33:53.917748 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:53.927795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d871-8c61-4aa8-a8ec-b31f77ebe01e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:53.987380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:53.988064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:53.988407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:53.988760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:53.989384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:53.991852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:53.999874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:54.020026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1270/2514] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:33:53 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:33:54.021463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:54.031609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8d4d7-c8af-4340-92cf-2283c798c7ea admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:54.036215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:54.036804 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.037078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.037346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.037983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:54.039593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:54.049538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1245/2515] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:33:54.054695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:54.067644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd8d3d-13cb-4658-9271-fa8871390226 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:54.073065 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bb797-5132-42f1-b363-b0a40300fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:54.073759 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bb797-5132-42f1-b363-b0a40300fce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.074126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bb797-5132-42f1-b363-b0a40300fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.074463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bb797-5132-42f1-b363-b0a40300fce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.075162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bb797-5132-42f1-b363-b0a40300fce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:54.076817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1bb797-5132-42f1-b363-b0a40300fce5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:54.088293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1271/2516] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:33:54.092660 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:54.102973 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a05b18-6e9f-4668-9a76-27f750d85d7a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:54.107662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:54.108317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.108604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.108884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] PATH_INFO: `/v3/projects/8267fb6d583f47f090b1fe193792b07b/users/5e1e836eaab944fb85ad19560d2f8ac1/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.124465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8267fb6d583f47f090b1fe193792b07b, user_id=5e1e836eaab944fb85ad19560d2f8ac1, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:54.127166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:54.140494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1246/2517] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:33:54 2022] PUT /identity/v3/projects/8267fb6d583f47f090b1fe193792b07b/users/5e1e836eaab944fb85ad19560d2f8ac1/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:33:54.152179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee5ed-f730-472e-b5a9-f0357cc09181 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.152515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee5ed-f730-472e-b5a9-f0357cc09181 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.152792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cee5ed-f730-472e-b5a9-f0357cc09181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.183477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-37cee5ed-f730-472e-b5a9-f0357cc09181 None None] MFA Rules not processed for user `5e1e836eaab944fb85ad19560d2f8ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:54.185071 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-37cee5ed-f730-472e-b5a9-f0357cc09181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:54.259357 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1272/2518] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:54.267127 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:54.268879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:54.284790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:54.360455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a503e-a9e8-4adf-873b-d6d162395418 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:54.367545 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01bf52-f108-41f9-9b93-634f5517a273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:54.368174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01bf52-f108-41f9-9b93-634f5517a273 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.368456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01bf52-f108-41f9-9b93-634f5517a273 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.368729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01bf52-f108-41f9-9b93-634f5517a273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.377620 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01bf52-f108-41f9-9b93-634f5517a273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:54.379288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01bf52-f108-41f9-9b93-634f5517a273 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:54.388730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1247/2519] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:33:54.599365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee5ed-f730-472e-b5a9-f0357cc09181 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:54.661226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cee5ed-f730-472e-b5a9-f0357cc09181 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:54.666544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:54.667165 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.667449 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.667723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] PATH_INFO: `/v3/users/5e1e836eaab944fb85ad19560d2f8ac1` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.668830 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1e836eaab944fb85ad19560d2f8ac1)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:54.670788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:54.719027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1e836eaab944fb85ad19560d2f8ac1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:54.727122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1e836eaab944fb85ad19560d2f8ac1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:54.727756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1e836eaab944fb85ad19560d2f8ac1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:54.734761 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1e836eaab944fb85ad19560d2f8ac1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:54.735376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1e836eaab944fb85ad19560d2f8ac1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:54.740386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:54.753890 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1273/2520] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:33:54 2022] DELETE /identity/v3/users/5e1e836eaab944fb85ad19560d2f8ac1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:54.758879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.759688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.759688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.779399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:54.780593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:54.843976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1248/2521] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:54.854755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:54.856224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:54.913774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e3078-e8d0-4408-b6f5-1aef19ef3fac admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:54.917444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea98726-0168-4291-b0c5-b33dba5ebaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:54.918045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea98726-0168-4291-b0c5-b33dba5ebaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:54.918354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea98726-0168-4291-b0c5-b33dba5ebaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:54.918627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea98726-0168-4291-b0c5-b33dba5ebaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:54.927689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea98726-0168-4291-b0c5-b33dba5ebaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:54.929414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea98726-0168-4291-b0c5-b33dba5ebaa9 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:54.939371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1274/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:55.206850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:55.208263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:55.221566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475feaff-5ec3-4ca3-b892-71aa58d90e14 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:55.226669 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:55.227299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.227581 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.227859 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] PATH_INFO: `/v3/projects/8267fb6d583f47f090b1fe193792b07b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.228963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8267fb6d583f47f090b1fe193792b07b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:55.231022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:55.403220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8267fb6d583f47f090b1fe193792b07b', 'request_id': 'req-a1920ab0-793e-426a-bcc7-41ea53b35550'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:55.410624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8267fb6d583f47f090b1fe193792b07b', 'request_id': 'req-a1920ab0-793e-426a-bcc7-41ea53b35550'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:55.417495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8267fb6d583f47f090b1fe193792b07b', 'request_id': 'req-a1920ab0-793e-426a-bcc7-41ea53b35550'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:55.428352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] The token cache is being invalidate because project 8267fb6d583f47f090b1fe193792b07b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:33:55.429310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:55.429897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1920ab0-793e-426a-bcc7-41ea53b35550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:33:55.431427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1249/2523] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:33:55 2022] DELETE /identity/v3/projects/8267fb6d583f47f090b1fe193792b07b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:55.436258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d755d5-17b0-4ab8-8dd8-5039d38ecbf4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.436724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d755d5-17b0-4ab8-8dd8-5039d38ecbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.436837 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d755d5-17b0-4ab8-8dd8-5039d38ecbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.458362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-32d755d5-17b0-4ab8-8dd8-5039d38ecbf4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:55.460623 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-32d755d5-17b0-4ab8-8dd8-5039d38ecbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:55.525212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1275/2524] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:55.532919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b833d-b63a-490d-b415-f72e2ac267b2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.533202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b833d-b63a-490d-b415-f72e2ac267b2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.533476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b833d-b63a-490d-b415-f72e2ac267b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.552535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2b0b833d-b63a-490d-b415-f72e2ac267b2 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:55.554374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2b0b833d-b63a-490d-b415-f72e2ac267b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:55.562284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1250/2525] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:55.566553 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d755d5-17b0-4ab8-8dd8-5039d38ecbf4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:55.578990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d755d5-17b0-4ab8-8dd8-5039d38ecbf4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:55.587339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:55.587945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.588250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.588522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.589215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:33:55.589517 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:55.591180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:55.603480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1276/2526] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:33:55.607830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b833d-b63a-490d-b415-f72e2ac267b2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:55.617194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b833d-b63a-490d-b415-f72e2ac267b2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:55.621838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:55.622466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.622744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.623012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.623638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:55.625503 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:55.639879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:55.652786 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1251/2527] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:33:55 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:33:55.657097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:55.667404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dac6d-77a7-4e4a-8ecc-5424cb8fb4fa admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:55.722122 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:55.722717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.722994 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.723265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.723924 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:55.726611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:55.747992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1277/2528] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:33:55 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:33:55.752052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:55.762337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48b00-b56d-48fd-9e71-dedd8a19be7c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:55.766928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:55.767523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.767799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.768070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.768708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:55.770309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:55.780994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1252/2529] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:33:55.784852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:55.795294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad220-aa8b-40c6-8a2a-10871a5fe18d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:55.799840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d658ab2-3723-4790-b189-4687b3a3af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:55.800423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658ab2-3723-4790-b189-4687b3a3af46 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.800699 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658ab2-3723-4790-b189-4687b3a3af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.800975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d658ab2-3723-4790-b189-4687b3a3af46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.801595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d658ab2-3723-4790-b189-4687b3a3af46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:55.803233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d658ab2-3723-4790-b189-4687b3a3af46 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:55.804571 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:55.815413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1278/2530] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:33:55.819937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:55.829885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65a06c-2430-40bf-871e-ad19ba11bcb1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:55.835408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:55.836071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.836348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.836619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] PATH_INFO: `/v3/projects/ac35d614c4f748659374fdea2fd10e5a/users/bc1e326c9a3344c7abee0a21e0c13fc2/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.851711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac35d614c4f748659374fdea2fd10e5a, user_id=bc1e326c9a3344c7abee0a21e0c13fc2, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:55.854391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:55.868051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1253/2531] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:33:55 2022] PUT /identity/v3/projects/ac35d614c4f748659374fdea2fd10e5a/users/bc1e326c9a3344c7abee0a21e0c13fc2/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:55.878325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2924d-97a6-428b-8082-1c76fdf1fa48 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:55.878612 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2924d-97a6-428b-8082-1c76fdf1fa48 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:55.878883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2924d-97a6-428b-8082-1c76fdf1fa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:55.906907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8fd2924d-97a6-428b-8082-1c76fdf1fa48 None None] MFA Rules not processed for user `bc1e326c9a3344c7abee0a21e0c13fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:55.908149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8fd2924d-97a6-428b-8082-1c76fdf1fa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:55.971675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1279/2532] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:55.976812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.041505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5a89-7fa7-402d-b129-b4e7b03691b9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.046039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.046668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.046944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.047213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.047848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.049787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.088575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1254/2533] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:33:55 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:33:56.090865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2924d-97a6-428b-8082-1c76fdf1fa48 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.102465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2924d-97a6-428b-8082-1c76fdf1fa48 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.162025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.163180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.163652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.163932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.164558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.166523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.188992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1280/2534] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:33:56 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:33:56.193232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.203854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf465ccf-f1b0-47fb-a03e-d401f36213f4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.208480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.209074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.209353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.210246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.210936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.212515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.222537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1255/2535] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:33:56.227338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.237763 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a9cc7-9d01-4eb6-b77b-2d0b5eed0834 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.242642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.243290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.243574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.243852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] PATH_INFO: `/v3/projects/85e40292067c4e0baa0747fe7d057f01/users/8e02f295389e495c8f52375a027e7c1f/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.258551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e40292067c4e0baa0747fe7d057f01, user_id=8e02f295389e495c8f52375a027e7c1f, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.261221 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.274225 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1281/2536] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:33:56 2022] PUT /identity/v3/projects/85e40292067c4e0baa0747fe7d057f01/users/8e02f295389e495c8f52375a027e7c1f/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:56.278544 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.289405 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117076c-f26d-48a5-a90c-b0b0509f67b8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.344091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12094-215b-4d5f-a098-0925e5bb62ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.344690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12094-215b-4d5f-a098-0925e5bb62ce admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.344972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12094-215b-4d5f-a098-0925e5bb62ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.345238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12094-215b-4d5f-a098-0925e5bb62ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.345868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12094-215b-4d5f-a098-0925e5bb62ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.347486 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12094-215b-4d5f-a098-0925e5bb62ce admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.357647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1256/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:33:56.361877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.372420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4516e7-b85e-4f5f-915c-75d1780d98e8 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.376928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.377566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.377842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.378151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] PATH_INFO: `/v3/projects/85e40292067c4e0baa0747fe7d057f01/users/8e02f295389e495c8f52375a027e7c1f/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.380074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85e40292067c4e0baa0747fe7d057f01, user_id=8e02f295389e495c8f52375a027e7c1f, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.382967 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.392853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1282/2538] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:33:56 2022] PUT /identity/v3/projects/85e40292067c4e0baa0747fe7d057f01/users/8e02f295389e495c8f52375a027e7c1f/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:33:56.404688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795556-638c-4331-bcc0-e44de02a58da None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.404891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795556-638c-4331-bcc0-e44de02a58da None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.405162 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7795556-638c-4331-bcc0-e44de02a58da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.432448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d7795556-638c-4331-bcc0-e44de02a58da None None] MFA Rules not processed for user `8e02f295389e495c8f52375a027e7c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:56.433558 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d7795556-638c-4331-bcc0-e44de02a58da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:56.450135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:56.513415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1257/2539] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:33:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:33:56.526142 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.527859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:56.576086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:56.593693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd5398-3399-4342-8a80-0d4fee8af946 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.597594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.598240 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.598522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.598794 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.608909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.610365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.619813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1283/2540] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:56.695209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795556-638c-4331-bcc0-e44de02a58da None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:56.705569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7795556-638c-4331-bcc0-e44de02a58da None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:56.709054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:56.709650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:56.709924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:56.710233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:56.768655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:56.770090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:56.779705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1258/2541] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:57.540666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:57.542085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:57.598006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80babc05-c70f-486f-b4a1-bbcd27c51687 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:57.602195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:57.603080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:57.603361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:57.603631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:57.605317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:57.614597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:57.616015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:57.624799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1284/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:57.926879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:57.928254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:58.000599 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02c679-3c47-4790-bf76-253d59c0c0e4 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:58.005577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c2443-538c-418d-86a6-70cc3cecd03e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:58.006282 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c2443-538c-418d-86a6-70cc3cecd03e service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:58.006625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c2443-538c-418d-86a6-70cc3cecd03e service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:58.006904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c2443-538c-418d-86a6-70cc3cecd03e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:58.008650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-568c2443-538c-418d-86a6-70cc3cecd03e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:58.020316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c2443-538c-418d-86a6-70cc3cecd03e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:58.021937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c2443-538c-418d-86a6-70cc3cecd03e service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:58.032659 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1259/2543] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:58.869241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:58.870671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:58.880733 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db56e3-02d0-41f4-8481-fe6bbcb837eb service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:58.885287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:58.885872 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:58.886183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:58.886453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:58.888095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:58.897455 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:58.898982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:58.908356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1285/2544] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:33:59.659949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:59.660394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:59.660625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:59.680505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:33:59.681685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:59.721155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:33:59.737777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1260/2545] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:33:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:33:59.750106 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:33:59.751508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:33:59.823902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b63ca-a543-4b42-a637-66515bb9bab0 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:33:59.828974 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e22fc-edd4-46a7-b585-12b3098734c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:33:59.829578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e22fc-edd4-46a7-b585-12b3098734c8 service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:33:59.829858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e22fc-edd4-46a7-b585-12b3098734c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:33:59.830166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e22fc-edd4-46a7-b585-12b3098734c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:33:59.838372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e22fc-edd4-46a7-b585-12b3098734c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:33:59.839964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e22fc-edd4-46a7-b585-12b3098734c8 service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:33:59.847955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1286/2546] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:34:09.742086 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=6 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:09.844693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=73 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:13.267353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:13.269441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:13.358304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0511c-c7f0-436b-8ea1-123028e4e9f3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:13.363714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:13.364314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:13.364586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:13.364852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:13.367283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:13.379868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:13.381500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:13.392665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1261/2547] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:14.739609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa797d-7afc-48f0-9609-50a8941204e9 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:14.740128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa797d-7afc-48f0-9609-50a8941204e9 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:14.740128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa797d-7afc-48f0-9609-50a8941204e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:14.762592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-daaa797d-7afc-48f0-9609-50a8941204e9 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:14.763811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-daaa797d-7afc-48f0-9609-50a8941204e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:14.772766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1287/2548] 10.222.0.18 () {58 vars in 967 bytes} [Fri Sep 30 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:14.785369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:14.796629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948e0bb-2dfd-485b-bebf-eb185d1f23a5 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:14.801444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:14.802025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:14.802332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:14.802596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:14.812739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:14.814359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:14.823526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1262/2549] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:34:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:34:18.705219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76626e8-d033-4142-a644-be53869905ee None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:18.705723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76626e8-d033-4142-a644-be53869905ee None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:18.705820 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76626e8-d033-4142-a644-be53869905ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:18.727446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c76626e8-d033-4142-a644-be53869905ee None None] MFA Rules not processed for user `7a28576fcbc34c0f9dda76e8b390928a`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:18.728652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c76626e8-d033-4142-a644-be53869905ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:18.784892 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1288/2550] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:19.101379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:19.110527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1ae72-fd3d-47d7-8b09-d5139d545e8d service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:19.113971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:19.114586 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:19.114855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:19.115140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:19.116972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:19.126265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:19.127656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:19.136066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1263/2551] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:21.962655 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76626e8-d033-4142-a644-be53869905ee None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:21.964146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c76626e8-d033-4142-a644-be53869905ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:21.981288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76626e8-d033-4142-a644-be53869905ee None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:21.987034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e39f-3ad1-467e-b6af-8a7b7fdece5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:21.987650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e39f-3ad1-467e-b6af-8a7b7fdece5f service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:21.987929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e39f-3ad1-467e-b6af-8a7b7fdece5f service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:21.988213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e39f-3ad1-467e-b6af-8a7b7fdece5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:21.989936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ac60e39f-3ad1-467e-b6af-8a7b7fdece5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:22.002539 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60e39f-3ad1-467e-b6af-8a7b7fdece5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:22.004133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60e39f-3ad1-467e-b6af-8a7b7fdece5f service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:22.014835 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1289/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:26.732943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:26.795742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2b24b-c7fa-436c-bc67-cbb97e9c247d service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:26.800213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:26.800824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:26.801161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:26.801371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] PATH_INFO: `/v3/users/bc1e326c9a3344c7abee0a21e0c13fc2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:26.803071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1e326c9a3344c7abee0a21e0c13fc2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:26.804966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:26.851449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1e326c9a3344c7abee0a21e0c13fc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:26.852100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1e326c9a3344c7abee0a21e0c13fc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:26.852706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1e326c9a3344c7abee0a21e0c13fc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:26.859553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1e326c9a3344c7abee0a21e0c13fc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:26.863158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:26.868212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1e326c9a3344c7abee0a21e0c13fc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:26.888220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1264/2553] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:26 2022] DELETE /identity/v3/users/bc1e326c9a3344c7abee0a21e0c13fc2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:26.892773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:26.893319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:26.893599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:26.912525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:26.913706 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:26.975368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1290/2554] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:26.984970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:26.986395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:27.044566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5244d71-22be-4535-8e47-4cc4ff2b9e82 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:27.048237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:27.048821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:27.049095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:27.049364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:27.058983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:27.060313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:27.070330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1265/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:27.359954 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:27.361674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:27.379044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7624b-8aea-4130-b519-3b29ded666b1 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:27.386268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:27.387149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:27.387638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:27.387896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] PATH_INFO: `/v3/projects/ac35d614c4f748659374fdea2fd10e5a` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:27.389158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac35d614c4f748659374fdea2fd10e5a)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:27.391163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:27.445222 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac35d614c4f748659374fdea2fd10e5a', 'request_id': 'req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.451373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac35d614c4f748659374fdea2fd10e5a', 'request_id': 'req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.459405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac35d614c4f748659374fdea2fd10e5a', 'request_id': 'req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.473496 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] The token cache is being invalidate because project ac35d614c4f748659374fdea2fd10e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:27.473945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.474621 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.476223 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1291/2556] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:27 2022] DELETE /identity/v3/projects/ac35d614c4f748659374fdea2fd10e5a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:27.480439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:27.490324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dbb24-44a6-4bda-b949-fa4446613607 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:27.550514 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:27.551460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:27.551742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:27.552367 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] PATH_INFO: `/v3/users/8e02f295389e495c8f52375a027e7c1f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:27.553708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e02f295389e495c8f52375a027e7c1f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:27.556737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:27.621188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e02f295389e495c8f52375a027e7c1f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.622031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e02f295389e495c8f52375a027e7c1f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.622898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e02f295389e495c8f52375a027e7c1f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.634218 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e02f295389e495c8f52375a027e7c1f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.644296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50149240-4823-4048-834c-31f7be68eecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e02f295389e495c8f52375a027e7c1f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:27.665602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:27.671340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1266/2557] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:27 2022] DELETE /identity/v3/users/8e02f295389e495c8f52375a027e7c1f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:27.997807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:27.999429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:28.014029 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbdc4-6c7c-47ec-83db-2438ad44bcb4 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.019000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:28.081766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.082365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.082647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.082920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] PATH_INFO: `/v3/projects/85e40292067c4e0baa0747fe7d057f01` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.084073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=85e40292067c4e0baa0747fe7d057f01)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.086000 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.132379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85e40292067c4e0baa0747fe7d057f01', 'request_id': 'req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:28.138411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85e40292067c4e0baa0747fe7d057f01', 'request_id': 'req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:28.145594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85e40292067c4e0baa0747fe7d057f01', 'request_id': 'req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:28.156479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] The token cache is being invalidate because project 85e40292067c4e0baa0747fe7d057f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:28.156767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:28.157387 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d11a4773-c512-4ee6-a20a-f48ef6ac21dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:28.158899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1292/2558] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:27 2022] DELETE /identity/v3/projects/85e40292067c4e0baa0747fe7d057f01 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:28.164708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b23e0-a5c2-4483-86e6-8c197f41257b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.165192 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b23e0-a5c2-4483-86e6-8c197f41257b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.165312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b23e0-a5c2-4483-86e6-8c197f41257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.185154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-620b23e0-a5c2-4483-86e6-8c197f41257b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:28.186387 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-620b23e0-a5c2-4483-86e6-8c197f41257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:28.245244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1267/2559] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:34:28.253123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8000c9-75b2-4a7d-826f-5625fe4c4f47 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.253414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8000c9-75b2-4a7d-826f-5625fe4c4f47 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.253690 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8000c9-75b2-4a7d-826f-5625fe4c4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.273203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-2b8000c9-75b2-4a7d-826f-5625fe4c4f47 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:28.274426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-2b8000c9-75b2-4a7d-826f-5625fe4c4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:28.282176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1293/2560] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:28.286211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b23e0-a5c2-4483-86e6-8c197f41257b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.296971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b23e0-a5c2-4483-86e6-8c197f41257b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.301592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.303345 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.303629 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.303902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.304549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:34:28.304851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.306539 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.318780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1268/2561] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:34:28.323184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8000c9-75b2-4a7d-826f-5625fe4c4f47 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.332672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8000c9-75b2-4a7d-826f-5625fe4c4f47 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.337440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.338095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.338410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.338685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.339321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.341254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.369343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1294/2562] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:28 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:28.373534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.384511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3b4cf-e0c4-432d-9dda-86f09c420935 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.442433 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.443095 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.443376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.443672 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.444318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.446277 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.467568 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1269/2563] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:28 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:28.471679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.482721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea214d-a11b-4f6a-8237-3d70dfbcb722 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.487552 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.488145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.488424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.488697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.489361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.491204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.501180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1295/2564] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:28.505022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.515290 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506bd95-e73e-446d-8c76-ca3cf7144f7f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.520004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a982eb-7dbc-41e5-ab3a-47ca4301dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.520588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a982eb-7dbc-41e5-ab3a-47ca4301dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.521908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a982eb-7dbc-41e5-ab3a-47ca4301dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.522224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a982eb-7dbc-41e5-ab3a-47ca4301dcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.522864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a982eb-7dbc-41e5-ab3a-47ca4301dcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.524427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a982eb-7dbc-41e5-ab3a-47ca4301dcd8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.535042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1270/2565] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:28.539113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.549070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf0dcf-f350-4922-b662-c5f8503b63c7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.554242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.554889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.555173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.555453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] PATH_INFO: `/v3/projects/63dced402b7045cb998aee3dd72b35f1/users/44623a896ef14a278f31b54355603fae/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.570740 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dced402b7045cb998aee3dd72b35f1, user_id=44623a896ef14a278f31b54355603fae, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.573382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.586408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1296/2566] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:28 2022] PUT /identity/v3/projects/63dced402b7045cb998aee3dd72b35f1/users/44623a896ef14a278f31b54355603fae/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:28.597852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb4ef-d508-4e2b-820f-1221bb18498e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.598211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb4ef-d508-4e2b-820f-1221bb18498e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.598469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb4ef-d508-4e2b-820f-1221bb18498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.625968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-07ccb4ef-d508-4e2b-820f-1221bb18498e None None] MFA Rules not processed for user `44623a896ef14a278f31b54355603fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:28.627174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-07ccb4ef-d508-4e2b-820f-1221bb18498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:28.681965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:28.691898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1271/2567] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:28.696703 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.737359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:28.761833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ab4b-2e2a-407d-8ee1-ad69e7c544c0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.766531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.767128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.767407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.767680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.768310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.770303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.805259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1297/2568] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:28 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:28.809704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb4ef-d508-4e2b-820f-1221bb18498e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.823028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb4ef-d508-4e2b-820f-1221bb18498e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.882296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.882838 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.883119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.883391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.884014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.885941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.907722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1272/2569] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:28 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:28.912216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.922691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a28f-e10d-42a1-880a-f3bd6f34dc2e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.927381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.927980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.928262 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.928555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.929182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.930847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.946504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1298/2570] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:34:28.947657 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:28.957719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dd5d3-2ef0-4630-9c94-0e406174f1ac admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:28.963239 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:28.964099 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:28.964447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:28.964730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] PATH_INFO: `/v3/projects/7ad9e6403aac4c139a5c7172e7452405/users/94b58cd7bcd641e78f5b5782645435e6/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:28.982708 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9e6403aac4c139a5c7172e7452405, user_id=94b58cd7bcd641e78f5b5782645435e6, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:28.985604 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:28.999010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1273/2571] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:28 2022] PUT /identity/v3/projects/7ad9e6403aac4c139a5c7172e7452405/users/94b58cd7bcd641e78f5b5782645435e6/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:29.003022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:29.013595 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d645a5-61f9-480d-9621-60c8a277cf3a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:29.071905 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707aefa-2474-4d20-84dc-2ad164ad499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:29.072516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707aefa-2474-4d20-84dc-2ad164ad499a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:29.072795 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707aefa-2474-4d20-84dc-2ad164ad499a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:29.073069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707aefa-2474-4d20-84dc-2ad164ad499a admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:29.073708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707aefa-2474-4d20-84dc-2ad164ad499a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:29.075333 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707aefa-2474-4d20-84dc-2ad164ad499a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:29.086391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1299/2572] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:29.090562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:29.101221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dccc14-b5bd-4bc8-bbbc-b9d3f513de3b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:29.105732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:29.106415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:29.106699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:29.106971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] PATH_INFO: `/v3/projects/7ad9e6403aac4c139a5c7172e7452405/users/94b58cd7bcd641e78f5b5782645435e6/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:29.108884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9e6403aac4c139a5c7172e7452405, user_id=94b58cd7bcd641e78f5b5782645435e6, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:29.111530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:29.121893 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1274/2573] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:29 2022] PUT /identity/v3/projects/7ad9e6403aac4c139a5c7172e7452405/users/94b58cd7bcd641e78f5b5782645435e6/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:29.132957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca573b0-c7c5-420e-85c8-b3801cdb39c0 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:29.133186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca573b0-c7c5-420e-85c8-b3801cdb39c0 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:29.133457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca573b0-c7c5-420e-85c8-b3801cdb39c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:29.162260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8ca573b0-c7c5-420e-85c8-b3801cdb39c0 None None] MFA Rules not processed for user `94b58cd7bcd641e78f5b5782645435e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:29.163440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8ca573b0-c7c5-420e-85c8-b3801cdb39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:29.232393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1300/2574] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:29.244179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:29.246134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:29.305516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3756f21-a965-40cc-ae46-54eefc08c390 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:29.310694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:29.311294 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:29.311570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:29.311836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:29.323982 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:29.325414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:29.336959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1275/2575] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:29.418150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca573b0-c7c5-420e-85c8-b3801cdb39c0 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:29.427908 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca573b0-c7c5-420e-85c8-b3801cdb39c0 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:29.431653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:29.432248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:29.432522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:29.432787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:29.463110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:29.493385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:29.494848 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:29.503463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1301/2576] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:31.255280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:31.257129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:31.319160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:31.344340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a2569-a721-4b73-9d78-52a99363cf32 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:31.350643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c189c0-8ade-4dc0-a370-433aaef886ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:31.351248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c189c0-8ade-4dc0-a370-433aaef886ec service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:31.351525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c189c0-8ade-4dc0-a370-433aaef886ec service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:31.351799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c189c0-8ade-4dc0-a370-433aaef886ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:31.353561 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c6c189c0-8ade-4dc0-a370-433aaef886ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:31.367271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c189c0-8ade-4dc0-a370-433aaef886ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:31.369136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c189c0-8ade-4dc0-a370-433aaef886ec service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:31.380554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1276/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:32.433652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:32.501569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b03b7-616d-487f-bd03-d2b8bfa92019 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:32.507120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:32.507755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:32.508038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:32.508312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] PATH_INFO: `/v3/users/44623a896ef14a278f31b54355603fae` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:32.509442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44623a896ef14a278f31b54355603fae)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:32.511383 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:32.560283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44623a896ef14a278f31b54355603fae'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:32.570876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44623a896ef14a278f31b54355603fae'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:32.571635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44623a896ef14a278f31b54355603fae'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:32.579325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44623a896ef14a278f31b54355603fae'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:32.580211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44623a896ef14a278f31b54355603fae'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:32.600927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1302/2578] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:32 2022] DELETE /identity/v3/users/44623a896ef14a278f31b54355603fae => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:32.605549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:32.606028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:32.606268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:32.626034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:32.627341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:32.687229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1277/2579] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:32.697365 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:32.698787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:32.758805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:32.763561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585eda9-006d-446c-92b9-6db1d202e147 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:32.768183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:32.769454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:32.769893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:32.770609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:32.780372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:32.781799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:32.792774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1303/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:33.078347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:33.079782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:33.093739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16af94-2922-4f48-800a-0527c298a579 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:33.099438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:33.100077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:33.100421 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:33.100610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] PATH_INFO: `/v3/projects/63dced402b7045cb998aee3dd72b35f1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:33.102348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dced402b7045cb998aee3dd72b35f1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:33.104703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:33.153460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dced402b7045cb998aee3dd72b35f1', 'request_id': 'req-b6292a93-12f7-4028-897d-9744213f7400'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.161043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dced402b7045cb998aee3dd72b35f1', 'request_id': 'req-b6292a93-12f7-4028-897d-9744213f7400'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.167310 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dced402b7045cb998aee3dd72b35f1', 'request_id': 'req-b6292a93-12f7-4028-897d-9744213f7400'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.178505 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] The token cache is being invalidate because project 63dced402b7045cb998aee3dd72b35f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:33.178856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.179538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.181190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1278/2581] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:33 2022] DELETE /identity/v3/projects/63dced402b7045cb998aee3dd72b35f1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:33.185219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:33.195705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3f214-c50c-464e-9734-89bb9bdc05b5 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:33.253484 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:33.254149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:33.254527 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:33.254993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] PATH_INFO: `/v3/users/94b58cd7bcd641e78f5b5782645435e6` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:33.256375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b58cd7bcd641e78f5b5782645435e6)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:33.258611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:33.305104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b58cd7bcd641e78f5b5782645435e6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.312146 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b58cd7bcd641e78f5b5782645435e6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.312755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b58cd7bcd641e78f5b5782645435e6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.320596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b58cd7bcd641e78f5b5782645435e6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.321210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-9ceeddbb-19ec-424b-b3a8-3fd988285dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b58cd7bcd641e78f5b5782645435e6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.339199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1304/2582] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:33 2022] DELETE /identity/v3/users/94b58cd7bcd641e78f5b5782645435e6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:33.602235 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:33.603744 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:33.618169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6292a93-12f7-4028-897d-9744213f7400 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:33.679403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:33.680024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:33.680302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:33.680574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] PATH_INFO: `/v3/projects/7ad9e6403aac4c139a5c7172e7452405` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:33.681668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad9e6403aac4c139a5c7172e7452405)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:33.683593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:33.685008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:33.732531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad9e6403aac4c139a5c7172e7452405', 'request_id': 'req-add3309d-c539-43e0-8189-d084a2234b7b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.740152 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad9e6403aac4c139a5c7172e7452405', 'request_id': 'req-add3309d-c539-43e0-8189-d084a2234b7b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.746179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad9e6403aac4c139a5c7172e7452405', 'request_id': 'req-add3309d-c539-43e0-8189-d084a2234b7b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.756902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] The token cache is being invalidate because project 7ad9e6403aac4c139a5c7172e7452405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:33.757185 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.757811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-add3309d-c539-43e0-8189-d084a2234b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:33.759289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1279/2583] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:33 2022] DELETE /identity/v3/projects/7ad9e6403aac4c139a5c7172e7452405 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:33.764233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3885cc4-cd89-4613-98cd-6b706f21cc27 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:33.764729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3885cc4-cd89-4613-98cd-6b706f21cc27 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:33.764846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3885cc4-cd89-4613-98cd-6b706f21cc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:33.784422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-b3885cc4-cd89-4613-98cd-6b706f21cc27 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:33.785613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-b3885cc4-cd89-4613-98cd-6b706f21cc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:33.846291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1305/2584] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:33.855347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfa2db-8a70-44c7-b611-97fabe7036f7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:33.855626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfa2db-8a70-44c7-b611-97fabe7036f7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:33.855894 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfa2db-8a70-44c7-b611-97fabe7036f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:33.877481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-eccfa2db-8a70-44c7-b611-97fabe7036f7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:33.878698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-eccfa2db-8a70-44c7-b611-97fabe7036f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:33.887180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1280/2585] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:34:33.891359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3885cc4-cd89-4613-98cd-6b706f21cc27 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:33.901414 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3885cc4-cd89-4613-98cd-6b706f21cc27 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:33.906135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:33.906735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:33.907018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:33.907290 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:33.907930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:34:33.908231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:33.909832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:33.916730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:33.922250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1306/2586] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:34:33.927111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfa2db-8a70-44c7-b611-97fabe7036f7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:33.936175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfa2db-8a70-44c7-b611-97fabe7036f7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:33.941382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:33.942083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:33.943075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:33.943391 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:33.944044 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:33.946092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:33.972981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1281/2587] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:33 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:33.977047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:33.986883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8652f-7b51-42b5-a94f-5fbf86e5331e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.043986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.044586 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.044865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.045136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.045762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.047701 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.075157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1307/2588] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:33 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:34.077314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.087516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c7d8a-788b-4fa2-b183-65f4080a1288 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.092068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.092656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.092931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.093197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.093829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.095449 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.105980 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1282/2589] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:34.109818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.120951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d536b75-0764-496c-befb-0a2af3688175 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.125507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bac98-3a57-47d9-b397-fd5aa0c88706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.126123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bac98-3a57-47d9-b397-fd5aa0c88706 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.126404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bac98-3a57-47d9-b397-fd5aa0c88706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.126673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bac98-3a57-47d9-b397-fd5aa0c88706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.127300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bac98-3a57-47d9-b397-fd5aa0c88706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.128880 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bac98-3a57-47d9-b397-fd5aa0c88706 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.139632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1308/2590] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:34.143778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.153690 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e15c6-e065-4c05-b233-066764d3e946 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.158269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.158905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.159180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.159448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] PATH_INFO: `/v3/projects/623d2828e63f479988efda9e69cbd808/users/042025595320444cb39fe74c7a6223cc/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.174388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=623d2828e63f479988efda9e69cbd808, user_id=042025595320444cb39fe74c7a6223cc, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.177706 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.190651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1283/2591] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:34 2022] PUT /identity/v3/projects/623d2828e63f479988efda9e69cbd808/users/042025595320444cb39fe74c7a6223cc/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:34.201171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb314e5e-6b80-4b8f-a7a1-a9695061d600 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.201583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb314e5e-6b80-4b8f-a7a1-a9695061d600 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.201916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb314e5e-6b80-4b8f-a7a1-a9695061d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.230178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-eb314e5e-6b80-4b8f-a7a1-a9695061d600 None None] MFA Rules not processed for user `042025595320444cb39fe74c7a6223cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:34.231380 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eb314e5e-6b80-4b8f-a7a1-a9695061d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:34.295540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1309/2592] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:34.300100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.361094 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85793a5d-6be8-4529-81b8-17829d17d587 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.366287 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.366878 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.367155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.367424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.368083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.369944 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.395991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1284/2593] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:34 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:34.400107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb314e5e-6b80-4b8f-a7a1-a9695061d600 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.411554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb314e5e-6b80-4b8f-a7a1-a9695061d600 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.468293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.468925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.469206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.469482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.470178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.472092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.483533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:34.494928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1310/2594] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:34 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:34.498868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.509512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a147-1acb-423e-afc2-70dba62fd213 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.513991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.514609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.514884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.515154 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.515783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.517347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.523199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:34.529411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1285/2595] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:34.533588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.546526 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e5e0-a189-43d0-a279-0fdb1dc12e1d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.551173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.552500 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.552783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.553060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] PATH_INFO: `/v3/projects/e8bc2beaf80844df915dc97750c89d73/users/9c02a518190047b59db048b5dedd92c3/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.568497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bc2beaf80844df915dc97750c89d73, user_id=9c02a518190047b59db048b5dedd92c3, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.571174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.584180 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1311/2596] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:34 2022] PUT /identity/v3/projects/e8bc2beaf80844df915dc97750c89d73/users/9c02a518190047b59db048b5dedd92c3/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:34.588380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.598929 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdce14b-85ea-448e-92fe-200ae1b24c66 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.654593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddf1af-9159-4e8e-a7fd-112680cc6614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.655223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddf1af-9159-4e8e-a7fd-112680cc6614 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.655419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddf1af-9159-4e8e-a7fd-112680cc6614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.655691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddf1af-9159-4e8e-a7fd-112680cc6614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.656327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddf1af-9159-4e8e-a7fd-112680cc6614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.657903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddf1af-9159-4e8e-a7fd-112680cc6614 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.668157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1286/2597] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:34:34.673490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.684157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895edd9-b99f-42b5-919f-c5adb4c26c34 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.688711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.689351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.689624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.690175 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] PATH_INFO: `/v3/projects/e8bc2beaf80844df915dc97750c89d73/users/9c02a518190047b59db048b5dedd92c3/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.692107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bc2beaf80844df915dc97750c89d73, user_id=9c02a518190047b59db048b5dedd92c3, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.694973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.706679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1312/2598] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:34 2022] PUT /identity/v3/projects/e8bc2beaf80844df915dc97750c89d73/users/9c02a518190047b59db048b5dedd92c3/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:34.717353 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.717647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.717924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.750024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] MFA Rules not processed for user `9c02a518190047b59db048b5dedd92c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:34.751273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:34.820246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1287/2599] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:34.830980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.833391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:34.893792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad571d99-8e1c-490e-89d6-e1de557a5645 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.898324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.898926 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.899255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.899506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:34.908829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:34.910212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:34.919756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1313/2600] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:34.967320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:34.968727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:34.980947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a1d7a-5565-4070-b5f6-c19c66b95c77 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:34.984646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911671d-9df0-4be4-8990-baeca118fb9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:34.985246 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911671d-9df0-4be4-8990-baeca118fb9b service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:34.985621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911671d-9df0-4be4-8990-baeca118fb9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:34.986146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911671d-9df0-4be4-8990-baeca118fb9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:35.045177 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911671d-9df0-4be4-8990-baeca118fb9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:35.046684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911671d-9df0-4be4-8990-baeca118fb9b service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:35.060059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1288/2601] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:38.400833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:38.466704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73fe40-7465-40da-9f3e-38afd17030a8 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:38.471256 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:38.471877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:38.472155 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:38.472426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] PATH_INFO: `/v3/users/042025595320444cb39fe74c7a6223cc` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:38.474113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=042025595320444cb39fe74c7a6223cc)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:38.476018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:38.524203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042025595320444cb39fe74c7a6223cc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:38.533409 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042025595320444cb39fe74c7a6223cc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:38.534115 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042025595320444cb39fe74c7a6223cc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:38.542123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042025595320444cb39fe74c7a6223cc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:38.542770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042025595320444cb39fe74c7a6223cc'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:38.544066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:38.566224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1314/2602] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:38 2022] DELETE /identity/v3/users/042025595320444cb39fe74c7a6223cc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:38.570936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:38.570936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:38.572171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:38.592382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:38.593575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:38.606775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:38.657448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1289/2603] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:38.669019 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:38.670511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:38.729913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf306ae0-66bf-466a-89a6-fc27686210dc admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:38.733628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:38.734269 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:38.734545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:38.734814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:38.744677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:38.746149 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:38.756352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1315/2604] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:39.039122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:39.040548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:39.058763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cc178-0a8b-4718-a454-65798a0e126f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:39.064290 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:39.065757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:39.065757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:39.065996 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] PATH_INFO: `/v3/projects/623d2828e63f479988efda9e69cbd808` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:39.067850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] RBAC: Authorizing `identity:delete_project(project_id=623d2828e63f479988efda9e69cbd808)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:39.069866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:39.118593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623d2828e63f479988efda9e69cbd808', 'request_id': 'req-f9358b2d-ae29-45b2-8001-02b82ef2e47c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.125841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623d2828e63f479988efda9e69cbd808', 'request_id': 'req-f9358b2d-ae29-45b2-8001-02b82ef2e47c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.133040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623d2828e63f479988efda9e69cbd808', 'request_id': 'req-f9358b2d-ae29-45b2-8001-02b82ef2e47c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.143411 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] The token cache is being invalidate because project 623d2828e63f479988efda9e69cbd808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:39.143697 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.144304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.145883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1290/2605] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:39 2022] DELETE /identity/v3/projects/623d2828e63f479988efda9e69cbd808 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:39.149807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:39.159279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f00f4c-009c-41df-a2e2-42ac0179393c service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:39.214540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:39.215163 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:39.215444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:39.215718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] PATH_INFO: `/v3/users/9c02a518190047b59db048b5dedd92c3` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:39.216822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c02a518190047b59db048b5dedd92c3)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:39.218947 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:39.265907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c02a518190047b59db048b5dedd92c3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.273487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c02a518190047b59db048b5dedd92c3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.274131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c02a518190047b59db048b5dedd92c3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.280953 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c02a518190047b59db048b5dedd92c3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.281567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ddee45b4-4bef-4486-9c5f-7cbc13f8f211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c02a518190047b59db048b5dedd92c3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.298206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1316/2606] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:39 2022] DELETE /identity/v3/users/9c02a518190047b59db048b5dedd92c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:39.741793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:39.747475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:39.762990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9358b2d-ae29-45b2-8001-02b82ef2e47c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:39.825187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:39.825853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:39.826163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:39.826439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] PATH_INFO: `/v3/projects/e8bc2beaf80844df915dc97750c89d73` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:39.827587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bc2beaf80844df915dc97750c89d73)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:39.829475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:39.875274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:39.878550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bc2beaf80844df915dc97750c89d73', 'request_id': 'req-5e367ff0-cc56-4477-be37-ea49ed10fd67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.888789 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bc2beaf80844df915dc97750c89d73', 'request_id': 'req-5e367ff0-cc56-4477-be37-ea49ed10fd67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.897867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bc2beaf80844df915dc97750c89d73', 'request_id': 'req-5e367ff0-cc56-4477-be37-ea49ed10fd67'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.908577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] The token cache is being invalidate because project e8bc2beaf80844df915dc97750c89d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:39.908863 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.909567 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5e367ff0-cc56-4477-be37-ea49ed10fd67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:39.911194 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1291/2607] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:39 2022] DELETE /identity/v3/projects/e8bc2beaf80844df915dc97750c89d73 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:39.917524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc2cd-2bd9-49ac-b6f4-ab0e0f6a9a3e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:39.918040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc2cd-2bd9-49ac-b6f4-ab0e0f6a9a3e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:39.918282 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc2cd-2bd9-49ac-b6f4-ab0e0f6a9a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:39.926618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:39.939185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f92cc2cd-2bd9-49ac-b6f4-ab0e0f6a9a3e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:39.941818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f92cc2cd-2bd9-49ac-b6f4-ab0e0f6a9a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:40.004789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1317/2608] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:40.013653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fc82-c1e5-4c8c-a9cb-f7f6944dc08c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.013941 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fc82-c1e5-4c8c-a9cb-f7f6944dc08c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.014248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fc82-c1e5-4c8c-a9cb-f7f6944dc08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.034577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1f70fc82-c1e5-4c8c-a9cb-f7f6944dc08c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:40.035802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1f70fc82-c1e5-4c8c-a9cb-f7f6944dc08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:40.046300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1292/2609] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:40.050433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc2cd-2bd9-49ac-b6f4-ab0e0f6a9a3e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.061346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc2cd-2bd9-49ac-b6f4-ab0e0f6a9a3e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.066471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.067072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.067506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.067776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.069007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:34:40.069343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.071650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.087873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1318/2610] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:34:40.092156 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fc82-c1e5-4c8c-a9cb-f7f6944dc08c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.101971 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fc82-c1e5-4c8c-a9cb-f7f6944dc08c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.106823 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.107417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.107692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.107960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.109268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.111670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.145129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1293/2611] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:40 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:40.146411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.157674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec0f9f-bda9-47d1-9c2c-fa2aaf89dc87 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.219896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.220519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.220800 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.221064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.221730 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.223751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.246547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1319/2612] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:40 2022] POST /identity/v3/users => generated 305 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:34:40.250548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.262037 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414a41e-ae2f-4e4f-9942-e1238e80a6f0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.275663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.276535 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.277045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.277967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.278692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.280530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.295574 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1294/2613] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:40.296847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.312731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7c8e-19e1-4b16-82b3-bb44127d535a admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.318031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753559a-f117-4b9b-936b-b08fcb26592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.319368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753559a-f117-4b9b-936b-b08fcb26592b admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.319572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753559a-f117-4b9b-936b-b08fcb26592b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.319784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753559a-f117-4b9b-936b-b08fcb26592b admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.320432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753559a-f117-4b9b-936b-b08fcb26592b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.322580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753559a-f117-4b9b-936b-b08fcb26592b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.334798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1320/2614] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:40.339355 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.351460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5616b-5d49-47d5-b1a4-7a0674afa9e4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.356767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.357534 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.357817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.358118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] PATH_INFO: `/v3/projects/f32eb02892c84849ab88466fcb26a0d7/users/3a63f1528c344be98e0c43ffdc3573be/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.373520 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f32eb02892c84849ab88466fcb26a0d7, user_id=3a63f1528c344be98e0c43ffdc3573be, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.376187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.390274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1295/2615] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:40 2022] PUT /identity/v3/projects/f32eb02892c84849ab88466fcb26a0d7/users/3a63f1528c344be98e0c43ffdc3573be/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:40.406316 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c83ad4-0108-4aec-9ef4-384d7f3a6838 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.406602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c83ad4-0108-4aec-9ef4-384d7f3a6838 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.406898 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c83ad4-0108-4aec-9ef4-384d7f3a6838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.442001 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-06c83ad4-0108-4aec-9ef4-384d7f3a6838 None None] MFA Rules not processed for user `3a63f1528c344be98e0c43ffdc3573be`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:40.444474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-06c83ad4-0108-4aec-9ef4-384d7f3a6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:40.508587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:40.521001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.521438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1321/2616] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:40.594255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d4e1d-f289-455c-a6aa-de03f0cf89d9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.599329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.600043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.600321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.600696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.601337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.604386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.640263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1296/2617] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:40 2022] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:40.645368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c83ad4-0108-4aec-9ef4-384d7f3a6838 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.671328 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c83ad4-0108-4aec-9ef4-384d7f3a6838 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.761186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.762195 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.762554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.762882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.763910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.766808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.790109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1322/2618] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:40 2022] POST /identity/v3/users => generated 310 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:40.794016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.805036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0580d1e2-9659-4388-a7af-615eacc95ccf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.809966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.810855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.811140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.811530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.812401 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.814921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.826076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1297/2619] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:40.830274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.840374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c0b20-0100-48c1-bbae-2c1971973356 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.845024 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.845669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.845951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.846264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] PATH_INFO: `/v3/projects/69c5f5a72a36477badb27bb7aa679aca/users/f5aac94f09d440fa86baa951ce11f785/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.861200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c5f5a72a36477badb27bb7aa679aca, user_id=f5aac94f09d440fa86baa951ce11f785, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.863910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.877046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1323/2620] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:40 2022] PUT /identity/v3/projects/69c5f5a72a36477badb27bb7aa679aca/users/f5aac94f09d440fa86baa951ce11f785/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:40.880938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.890752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21af5ee-6fe7-4397-8f16-b9f01f5d858b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.932873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:40.949647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026874fb-8f91-4289-9977-8de53f7ade79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.950215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026874fb-8f91-4289-9977-8de53f7ade79 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.950494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026874fb-8f91-4289-9977-8de53f7ade79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.950767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026874fb-8f91-4289-9977-8de53f7ade79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.951393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026874fb-8f91-4289-9977-8de53f7ade79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.952957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026874fb-8f91-4289-9977-8de53f7ade79 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.963026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1298/2621] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:40.967310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:40.977822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6df75e-e220-4201-973c-b69fca03a335 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:40.982348 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:40.982986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:40.983259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:40.983528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] PATH_INFO: `/v3/projects/69c5f5a72a36477badb27bb7aa679aca/users/f5aac94f09d440fa86baa951ce11f785/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:40.985392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c5f5a72a36477badb27bb7aa679aca, user_id=f5aac94f09d440fa86baa951ce11f785, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:40.988033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:40.998886 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1324/2622] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:40 2022] PUT /identity/v3/projects/69c5f5a72a36477badb27bb7aa679aca/users/f5aac94f09d440fa86baa951ce11f785/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:41.011051 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc6cb-5bd7-4f1e-aa10-33f91c056387 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:41.011494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc6cb-5bd7-4f1e-aa10-33f91c056387 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:41.011774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc6cb-5bd7-4f1e-aa10-33f91c056387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:41.041881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-079bc6cb-5bd7-4f1e-aa10-33f91c056387 None None] MFA Rules not processed for user `f5aac94f09d440fa86baa951ce11f785`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:41.043122 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-079bc6cb-5bd7-4f1e-aa10-33f91c056387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:41.129457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1299/2623] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:41 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:41.141235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:41.143160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:41.205490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b641f-f181-4389-9b8e-90dde3572e72 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:41.209636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:41.210444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:41.210724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:41.210992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:41.220378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:41.221817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:41.232659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1325/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:41 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:41.384554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc6cb-5bd7-4f1e-aa10-33f91c056387 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:41.391764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc6cb-5bd7-4f1e-aa10-33f91c056387 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:41.395370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:41.395988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:41.396793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:41.397061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:41.454677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:41.456167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:41.467740 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1300/2625] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:42.006971 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:42.008716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:42.065604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb820d-06cc-49bf-89c6-000d20cb866c service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:42.070082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d30844-b25e-41e7-a920-06b30ec5b80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:42.070710 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30844-b25e-41e7-a920-06b30ec5b80c service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:42.070985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30844-b25e-41e7-a920-06b30ec5b80c service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:42.071255 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30844-b25e-41e7-a920-06b30ec5b80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:42.072960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-33d30844-b25e-41e7-a920-06b30ec5b80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:42.079127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:42.137838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d30844-b25e-41e7-a920-06b30ec5b80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:42.139314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d30844-b25e-41e7-a920-06b30ec5b80c service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:42.149014 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1326/2626] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:46.811709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:46.824671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a92e-c791-4793-9ff6-8472d3fd1053 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:46.829441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:46.830083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:46.830366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:46.830635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] PATH_INFO: `/v3/users/3a63f1528c344be98e0c43ffdc3573be` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:46.831773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a63f1528c344be98e0c43ffdc3573be)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:46.833703 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:46.882046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a63f1528c344be98e0c43ffdc3573be'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:46.882715 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a63f1528c344be98e0c43ffdc3573be'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:46.883304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a63f1528c344be98e0c43ffdc3573be'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:46.890348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a63f1528c344be98e0c43ffdc3573be'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:46.892788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:46.899751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a63f1528c344be98e0c43ffdc3573be'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:46.920076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1301/2627] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:46 2022] DELETE /identity/v3/users/3a63f1528c344be98e0c43ffdc3573be => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:46.924653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:46.925192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:46.925320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:46.946279 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:46.947504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:47.018124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1327/2628] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:47.024985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:47.026508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:47.094901 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4633d-b199-4446-8935-4d6003ae146c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:47.098612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:47.101169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:47.101169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:47.101169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:47.111061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:47.112635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:47.123644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1302/2629] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:47.435948 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:47.437493 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:47.450689 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07bb43-c191-4889-87b6-8dc1c236f1e4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:47.455447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:47.456084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:47.456359 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:47.456625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] PATH_INFO: `/v3/projects/f32eb02892c84849ab88466fcb26a0d7` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:47.457784 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f32eb02892c84849ab88466fcb26a0d7)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:47.460463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:47.529465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f32eb02892c84849ab88466fcb26a0d7', 'request_id': 'req-92d04287-e773-4551-972f-553896c50d60'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.537303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f32eb02892c84849ab88466fcb26a0d7', 'request_id': 'req-92d04287-e773-4551-972f-553896c50d60'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.547266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f32eb02892c84849ab88466fcb26a0d7', 'request_id': 'req-92d04287-e773-4551-972f-553896c50d60'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.562647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] The token cache is being invalidate because project f32eb02892c84849ab88466fcb26a0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:47.562950 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.563686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.565796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1328/2630] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:47 2022] DELETE /identity/v3/projects/f32eb02892c84849ab88466fcb26a0d7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:47.570749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:47.581253 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83395a7-179b-4da0-b1c3-df924452e824 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:47.647991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:47.648624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:47.648905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:47.649175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] PATH_INFO: `/v3/users/f5aac94f09d440fa86baa951ce11f785` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:47.650409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5aac94f09d440fa86baa951ce11f785)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:47.652314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:47.701001 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5aac94f09d440fa86baa951ce11f785'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.701656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5aac94f09d440fa86baa951ce11f785'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.702292 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5aac94f09d440fa86baa951ce11f785'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.710705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5aac94f09d440fa86baa951ce11f785'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.719055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7c526954-610f-4f9b-834e-5c2b6a8273ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5aac94f09d440fa86baa951ce11f785'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:47.733594 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:47.739140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1303/2631] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:47 2022] DELETE /identity/v3/users/f5aac94f09d440fa86baa951ce11f785 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:48.174361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.178039 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:48.192114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d04287-e773-4551-972f-553896c50d60 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.217591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:48.262471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.263339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.263793 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.264107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] PATH_INFO: `/v3/projects/69c5f5a72a36477badb27bb7aa679aca` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.265312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c5f5a72a36477badb27bb7aa679aca)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.267304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.322193 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c5f5a72a36477badb27bb7aa679aca', 'request_id': 'req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.330346 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c5f5a72a36477badb27bb7aa679aca', 'request_id': 'req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.339181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c5f5a72a36477badb27bb7aa679aca', 'request_id': 'req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.352465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] The token cache is being invalidate because project 69c5f5a72a36477badb27bb7aa679aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:48.352774 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.353441 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-67c4da99-6f20-42c2-8bfd-e7e7be71ff99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.355318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1329/2632] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:48 2022] DELETE /identity/v3/projects/69c5f5a72a36477badb27bb7aa679aca => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:48.359852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e833-96ac-4b07-8067-780e5378e68c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.360788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e833-96ac-4b07-8067-780e5378e68c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.361243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e833-96ac-4b07-8067-780e5378e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.382903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a735e833-96ac-4b07-8067-780e5378e68c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:48.384417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a735e833-96ac-4b07-8067-780e5378e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:48.464612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1304/2633] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:48.472117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8d285-ee4e-4155-9bd5-1e4c9a0e6fb8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.472529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8d285-ee4e-4155-9bd5-1e4c9a0e6fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.472822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8d285-ee4e-4155-9bd5-1e4c9a0e6fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.494367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a1e8d285-ee4e-4155-9bd5-1e4c9a0e6fb8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:48.495778 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a1e8d285-ee4e-4155-9bd5-1e4c9a0e6fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:48.509804 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1330/2634] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:34:48.514587 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735e833-96ac-4b07-8067-780e5378e68c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.526240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735e833-96ac-4b07-8067-780e5378e68c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.533636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.534388 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.534734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.535073 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.535794 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:34:48.536171 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.538440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.553210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1305/2635] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 30 19:34:48.558417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8d285-ee4e-4155-9bd5-1e4c9a0e6fb8 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.568588 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8d285-ee4e-4155-9bd5-1e4c9a0e6fb8 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.573807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.574542 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.575021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.575485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.576212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.578478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.612529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1331/2636] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:48 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:48.613052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.625425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0771a-f309-490f-9f52-2cca26e378d7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.703164 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.703803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.704082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.704349 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.704992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.708676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.733324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1306/2637] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:48 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:34:48.737347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.752130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38cc678-ce42-471f-85c5-3e23e258e9e7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.758473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.759310 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.759749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.760148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.760831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.762477 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.784011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1332/2638] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:48.788813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.802698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed3145-ad93-4b85-984d-07f75cd2ac8f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.811461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.812265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.812555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.812819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.813714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.816175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.823171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.826037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:48.829481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1307/2639] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:48.837080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:48.842660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0102d-96e1-4840-843b-3a0e24682432 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.846966 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ab4b-8f0f-4867-815f-6342840bfb5f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:48.847888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.848516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.849348 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.849680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] PATH_INFO: `/v3/users/0508dadbb3dc45b1bdf4d4fe83c4dac3` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.850842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0508dadbb3dc45b1bdf4d4fe83c4dac3)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.852851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9496-a021-48ba-91d6-a6d009a9ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:48.853053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.853614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9496-a021-48ba-91d6-a6d009a9ff2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.853958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9496-a021-48ba-91d6-a6d009a9ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.854339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9496-a021-48ba-91d6-a6d009a9ff2d admin admin] PATH_INFO: `/v3/projects/2cba0bfcbff0443593719b8471e8838c/users/0c4579b348c8475f8eaf506f0cba369c/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.869938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9496-a021-48ba-91d6-a6d009a9ff2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cba0bfcbff0443593719b8471e8838c, user_id=0c4579b348c8475f8eaf506f0cba369c, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:48.872667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b9496-a021-48ba-91d6-a6d009a9ff2d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:48.887170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1308/2640] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:48 2022] PUT /identity/v3/projects/2cba0bfcbff0443593719b8471e8838c/users/0c4579b348c8475f8eaf506f0cba369c/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:48.898908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:48.899248 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:48.899525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:48.910284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0508dadbb3dc45b1bdf4d4fe83c4dac3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.919070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0508dadbb3dc45b1bdf4d4fe83c4dac3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.919913 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0508dadbb3dc45b1bdf4d4fe83c4dac3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.932669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0508dadbb3dc45b1bdf4d4fe83c4dac3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.932881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] MFA Rules not processed for user `0c4579b348c8475f8eaf506f0cba369c`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:48.932986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0508dadbb3dc45b1bdf4d4fe83c4dac3'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:48.933089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:48.936402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:48.950677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1333/2641] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:48 2022] DELETE /identity/v3/users/0508dadbb3dc45b1bdf4d4fe83c4dac3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:48.963466 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:49.002821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1309/2642] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:49.013956 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:49.015528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:49.081170 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663336c3-e32b-44ba-870b-3ee1a7e2a7d2 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:49.085637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:49.086271 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:49.086555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:49.086949 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:49.131810 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:49.133424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:49.150314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:49.151862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:49.163016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1334/2643] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:49.219868 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444f6e-b75d-4d09-84cc-1241bcb05b1d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:49.283731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:49.284364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:49.284642 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:49.284909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] PATH_INFO: `/v3/projects/fab1effc235a4a90b98bf2a89f5e39bd` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:49.286027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab1effc235a4a90b98bf2a89f5e39bd)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:49.288183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:49.356633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab1effc235a4a90b98bf2a89f5e39bd', 'request_id': 'req-58e62416-f96e-4cc8-87d4-9148767d563f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.363884 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab1effc235a4a90b98bf2a89f5e39bd', 'request_id': 'req-58e62416-f96e-4cc8-87d4-9148767d563f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.372954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab1effc235a4a90b98bf2a89f5e39bd', 'request_id': 'req-58e62416-f96e-4cc8-87d4-9148767d563f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.386352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] The token cache is being invalidate because project fab1effc235a4a90b98bf2a89f5e39bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:49.386651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.387319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.389256 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1310/2644] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:49 2022] DELETE /identity/v3/projects/fab1effc235a4a90b98bf2a89f5e39bd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:49.394164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:49.411092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42a448-e2aa-4589-80ea-74b303e2b5d2 service cinder] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:49.498783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:49.499549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:49.499907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:49.500253 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] PATH_INFO: `/v3/users/51bbcba812554883a0f5517651747c4b` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:49.501587 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51bbcba812554883a0f5517651747c4b)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:49.503711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:49.572893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:49.574828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51bbcba812554883a0f5517651747c4b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.583625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51bbcba812554883a0f5517651747c4b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.584541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51bbcba812554883a0f5517651747c4b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.591631 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51bbcba812554883a0f5517651747c4b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.592268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51bbcba812554883a0f5517651747c4b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.610479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1335/2645] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:49 2022] DELETE /identity/v3/users/51bbcba812554883a0f5517651747c4b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:49.802877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:49.804304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:49.819549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e62416-f96e-4cc8-87d4-9148767d563f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:49.823686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:49.890523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:49.891206 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:49.891487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:49.891788 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] PATH_INFO: `/v3/projects/facb1c0f50aa4905b5fe5bf011dbfe05` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:49.893015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=facb1c0f50aa4905b5fe5bf011dbfe05)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:49.894927 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:49.942316 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facb1c0f50aa4905b5fe5bf011dbfe05', 'request_id': 'req-7361cd8b-f20b-4577-8cce-913251729915'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.950112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facb1c0f50aa4905b5fe5bf011dbfe05', 'request_id': 'req-7361cd8b-f20b-4577-8cce-913251729915'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.956842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facb1c0f50aa4905b5fe5bf011dbfe05', 'request_id': 'req-7361cd8b-f20b-4577-8cce-913251729915'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.967446 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] The token cache is being invalidate because project facb1c0f50aa4905b5fe5bf011dbfe05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:49.967731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.968370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7361cd8b-f20b-4577-8cce-913251729915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:49.969822 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1311/2646] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:49 2022] DELETE /identity/v3/projects/facb1c0f50aa4905b5fe5bf011dbfe05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:52.268242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:52.269858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:52.283293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03836c2a-c959-4742-8285-2a8a3aeb3ca8 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:52.340792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:52.341436 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:52.341717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:52.341992 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] PATH_INFO: `/v3/users/0c4579b348c8475f8eaf506f0cba369c` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:52.343229 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4579b348c8475f8eaf506f0cba369c)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:52.345159 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:52.392647 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4579b348c8475f8eaf506f0cba369c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:52.400893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4579b348c8475f8eaf506f0cba369c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:52.401650 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4579b348c8475f8eaf506f0cba369c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:52.409613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4579b348c8475f8eaf506f0cba369c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:52.410375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4579b348c8475f8eaf506f0cba369c'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:52.433626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1336/2647] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:34:52 2022] DELETE /identity/v3/users/0c4579b348c8475f8eaf506f0cba369c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:52.438096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:52.438577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:52.438691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:52.459946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:52.461179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:52.534726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1312/2648] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:52.545174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:52.547258 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:52.606100 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:52.620875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233625a7-a518-4113-acb2-fceffc949fc7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:52.625046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612be71-9aa8-41da-90b7-19323b659535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:52.625651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612be71-9aa8-41da-90b7-19323b659535 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:52.625933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612be71-9aa8-41da-90b7-19323b659535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:52.626246 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612be71-9aa8-41da-90b7-19323b659535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:52.636421 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612be71-9aa8-41da-90b7-19323b659535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:52.637912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612be71-9aa8-41da-90b7-19323b659535 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:52.647877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1337/2649] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:34:53.182237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.183671 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:53.196042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fd7dc-a1d7-4bad-960a-90aac7b70fc0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:53.200649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:53.201285 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.201560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.201829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] PATH_INFO: `/v3/projects/2cba0bfcbff0443593719b8471e8838c` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.202963 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cba0bfcbff0443593719b8471e8838c)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:53.204864 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:53.245211 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:53.269222 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cba0bfcbff0443593719b8471e8838c', 'request_id': 'req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:53.279647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cba0bfcbff0443593719b8471e8838c', 'request_id': 'req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:53.288281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cba0bfcbff0443593719b8471e8838c', 'request_id': 'req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:53.301040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] The token cache is being invalidate because project 2cba0bfcbff0443593719b8471e8838c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:34:53.301337 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:53.302067 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-178f15a3-5dc0-48e1-972e-ef32ea7b0eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:34:53.303874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1313/2650] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:34:53 2022] DELETE /identity/v3/projects/2cba0bfcbff0443593719b8471e8838c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:34:53.308578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aab465-2c63-4325-b53e-9fa3da4eef7f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.309028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aab465-2c63-4325-b53e-9fa3da4eef7f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.309185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aab465-2c63-4325-b53e-9fa3da4eef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.329495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a1aab465-2c63-4325-b53e-9fa3da4eef7f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:53.330834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a1aab465-2c63-4325-b53e-9fa3da4eef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:53.393284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1338/2651] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:34:53.465100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc55ba-e094-44e4-ae45-1183df08fe79 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.465854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc55ba-e094-44e4-ae45-1183df08fe79 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.465854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc55ba-e094-44e4-ae45-1183df08fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.488681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fddc55ba-e094-44e4-ae45-1183df08fe79 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:53.490533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fddc55ba-e094-44e4-ae45-1183df08fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:53.498555 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1314/2652] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:53.502809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aab465-2c63-4325-b53e-9fa3da4eef7f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.513548 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aab465-2c63-4325-b53e-9fa3da4eef7f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:53.518268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:53.518874 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.519151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.519423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.521840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:34:53.522182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:53.523888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:53.536936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1339/2653] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:34:53.541271 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc55ba-e094-44e4-ae45-1183df08fe79 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.550628 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc55ba-e094-44e4-ae45-1183df08fe79 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:53.555958 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:53.556557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.556836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.557105 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.557931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:53.563400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:53.590221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1315/2654] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:34:53 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:53.594378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.605133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe1225-42c3-4ba5-9072-829f63cb4e28 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:53.663585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:53.664188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.664464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.664731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.665362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:53.667287 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:53.689644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1340/2655] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:34:53 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:34:53.694538 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.704876 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6261ed0-13cb-4893-b508-9e9553a59253 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:53.710092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:53.710692 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.710965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.711234 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.711874 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:53.713455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:53.726312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1316/2656] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:34:53.727658 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.737812 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd5728-3d72-4d07-9c0e-3d768a7c1ae6 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:53.742506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc29a34-7290-4bb4-8746-4d4c1dda0203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:53.743105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29a34-7290-4bb4-8746-4d4c1dda0203 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.743386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29a34-7290-4bb4-8746-4d4c1dda0203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.743659 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc29a34-7290-4bb4-8746-4d4c1dda0203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.744302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc29a34-7290-4bb4-8746-4d4c1dda0203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:53.745899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc29a34-7290-4bb4-8746-4d4c1dda0203 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:53.757308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1341/2657] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 30 19:34:53.761550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.772317 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8590b9-0e4a-40a2-91c7-008f63741a27 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:53.776858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:53.777511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.777792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.778085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] PATH_INFO: `/v3/projects/edd40c93fc13441f894b10a2fd384155/users/73d9d4215ca84114a2b246995aec3dd6/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.797582 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd40c93fc13441f894b10a2fd384155, user_id=73d9d4215ca84114a2b246995aec3dd6, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:53.800412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:53.813679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1317/2658] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:34:53 2022] PUT /identity/v3/projects/edd40c93fc13441f894b10a2fd384155/users/73d9d4215ca84114a2b246995aec3dd6/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:34:53.819615 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266f83-ce8e-4110-b55b-f2aebfc41394 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:53.819899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266f83-ce8e-4110-b55b-f2aebfc41394 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:53.820174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a266f83-ce8e-4110-b55b-f2aebfc41394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:53.841742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9a266f83-ce8e-4110-b55b-f2aebfc41394 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:53.843027 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9a266f83-ce8e-4110-b55b-f2aebfc41394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:53.894308 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:53.910694 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1342/2659] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:53.920308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:53.922199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:54.001082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5917f00-8ae8-409d-a5d9-ef9f9d69bc0d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:54.006221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:54.006885 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:54.007168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:54.007464 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:54.017111 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:54.018569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:54.029554 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1318/2660] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:34:54.687877 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab995-0c20-4a11-894e-59c14473a1ed None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:54.688390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab995-0c20-4a11-894e-59c14473a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:54.688508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ab995-0c20-4a11-894e-59c14473a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:54.717090 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d56ab995-0c20-4a11-894e-59c14473a1ed None None] MFA Rules not processed for user `73d9d4215ca84114a2b246995aec3dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:54.718342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d56ab995-0c20-4a11-894e-59c14473a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:54.786842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1343/2661] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:54.797757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:54.799260 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:54.861961 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7a88-a7aa-43b0-8624-bf1316cc8e56 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:54.865852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:54.866481 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:54.866759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:54.867031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:54.875507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:54.876934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:54.886020 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1319/2662] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:34:56.265810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:56.266326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:56.266424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:56.287708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] MFA Rules not processed for user `73d9d4215ca84114a2b246995aec3dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:34:56.288901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:56.295693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1344/2663] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:34:56.413513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:34:56.414928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:56.421801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:34:56.428327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6018d3c-69ad-4b47-8e5f-3163cb227d55 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:34:56.432985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:34:56.433751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:34:56.434119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:34:56.434733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:34:56.436508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:34:56.450403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:34:56.451850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:34:56.464549 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1320/2664] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:00.371977 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:00.373444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:00.389273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a85399-07eb-43fe-92f4-b87155dc8691 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:00.394873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:00.396049 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:00.397440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:00.398026 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] PATH_INFO: `/v3/users/74754bc2aec247f596c7f7317e0dc7e9` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:00.399844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74754bc2aec247f596c7f7317e0dc7e9)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:00.405274 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:00.577745 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74754bc2aec247f596c7f7317e0dc7e9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.585266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74754bc2aec247f596c7f7317e0dc7e9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.586132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74754bc2aec247f596c7f7317e0dc7e9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.594007 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74754bc2aec247f596c7f7317e0dc7e9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.594698 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-bac79662-4fb7-44b9-9f85-a1a9b7e6ce84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74754bc2aec247f596c7f7317e0dc7e9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.612832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1345/2665] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:35:00 2022] DELETE /identity/v3/users/74754bc2aec247f596c7f7317e0dc7e9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:00.790506 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:00.802043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589903d2-2979-47dd-bb36-a1d880517ffc service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:00.869986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:00.870640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:00.870916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:00.871180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] PATH_INFO: `/v3/projects/266f949be0924bafbd5d97bd44ce9a30` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:00.872288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=266f949be0924bafbd5d97bd44ce9a30)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:00.874195 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:00.921806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266f949be0924bafbd5d97bd44ce9a30', 'request_id': 'req-c500a449-ad00-481c-9439-cb8663a6d904'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.929580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266f949be0924bafbd5d97bd44ce9a30', 'request_id': 'req-c500a449-ad00-481c-9439-cb8663a6d904'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.936382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266f949be0924bafbd5d97bd44ce9a30', 'request_id': 'req-c500a449-ad00-481c-9439-cb8663a6d904'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.947881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] The token cache is being invalidate because project 266f949be0924bafbd5d97bd44ce9a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:35:00.948167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.948799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c500a449-ad00-481c-9439-cb8663a6d904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:00.950302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1321/2666] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:35:00 2022] DELETE /identity/v3/projects/266f949be0924bafbd5d97bd44ce9a30 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:00.955390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739824-3b5c-4be0-a6ae-dc24464b66b1 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:00.955670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739824-3b5c-4be0-a6ae-dc24464b66b1 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:00.955942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739824-3b5c-4be0-a6ae-dc24464b66b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:00.976975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-53739824-3b5c-4be0-a6ae-dc24464b66b1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:00.978200 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-53739824-3b5c-4be0-a6ae-dc24464b66b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:01.018985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:01.039320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1346/2667] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:01.048427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36150e-5376-4d81-8e82-7823689d5047 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.048736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36150e-5376-4d81-8e82-7823689d5047 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.049004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36150e-5376-4d81-8e82-7823689d5047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.069676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-db36150e-5376-4d81-8e82-7823689d5047 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:01.070945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-db36150e-5376-4d81-8e82-7823689d5047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:01.079166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1322/2668] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:01.084236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739824-3b5c-4be0-a6ae-dc24464b66b1 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:01.093938 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739824-3b5c-4be0-a6ae-dc24464b66b1 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:01.098678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:01.099264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.099550 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.099815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.100482 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:35:01.100785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:01.102447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:01.113719 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1347/2669] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:35:01.117976 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36150e-5376-4d81-8e82-7823689d5047 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:01.127054 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36150e-5376-4d81-8e82-7823689d5047 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:01.132259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:01.132839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.133141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.133406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.134016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:01.136004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:01.163180 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1323/2670] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:35:01 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:01.167361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:01.177259 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce027db-1a57-4abf-b7c4-1df33d5449d9 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:01.237242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:01.238166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.238600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.238881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.239697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:01.241981 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:01.262758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1348/2671] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:35:01 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:01.267184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:01.278098 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e41ea-55bd-490c-8d4e-4257d8d1be44 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:01.282776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:01.283366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.283644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.283914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.284592 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:01.286704 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:01.298580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1324/2672] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:01.303248 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:01.313334 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe86b-d612-4e14-8e50-984683817f10 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:01.320397 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f919-a018-43ce-a68a-e69228b95d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:01.321031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f919-a018-43ce-a68a-e69228b95d0c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.321427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f919-a018-43ce-a68a-e69228b95d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.321707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f919-a018-43ce-a68a-e69228b95d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.322385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f919-a018-43ce-a68a-e69228b95d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:01.323972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071f919-a018-43ce-a68a-e69228b95d0c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:01.335251 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1349/2673] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:01.339531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:01.349687 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c3da2-ef4d-424c-a916-2f2c57ff816a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:01.354242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:01.354902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.355685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.355685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] PATH_INFO: `/v3/projects/ab103e6c5473454c9085d335d0735a13/users/acfcb93778954a7f835f51b98669f356/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.371422 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab103e6c5473454c9085d335d0735a13, user_id=acfcb93778954a7f835f51b98669f356, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:01.374080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:01.388346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1325/2674] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:01 2022] PUT /identity/v3/projects/ab103e6c5473454c9085d335d0735a13/users/acfcb93778954a7f835f51b98669f356/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:01.399856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8818b7-ddcb-452e-a926-348a4fac0e6d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.400368 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8818b7-ddcb-452e-a926-348a4fac0e6d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.400497 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8818b7-ddcb-452e-a926-348a4fac0e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.430545 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-0e8818b7-ddcb-452e-a926-348a4fac0e6d None None] MFA Rules not processed for user `acfcb93778954a7f835f51b98669f356`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:01.431831 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0e8818b7-ddcb-452e-a926-348a4fac0e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:01.506847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1350/2675] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:01.517914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:01.519650 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:01.539190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:01.604646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426e12-40a2-4594-a1c9-58659a0d7994 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:01.611061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c55603-abfd-40fa-a50a-6847643ae16d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:01.611670 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55603-abfd-40fa-a50a-6847643ae16d service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:01.611946 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55603-abfd-40fa-a50a-6847643ae16d service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:01.612242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55603-abfd-40fa-a50a-6847643ae16d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:01.621397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c55603-abfd-40fa-a50a-6847643ae16d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:01.622997 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c55603-abfd-40fa-a50a-6847643ae16d service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:01.633348 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1326/2676] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:04.325901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8818b7-ddcb-452e-a926-348a4fac0e6d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:04.369068 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:04.388473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8818b7-ddcb-452e-a926-348a4fac0e6d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:04.393046 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:04.393669 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:04.393965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:04.394869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] PATH_INFO: `/v3/users/acfcb93778954a7f835f51b98669f356` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:04.395997 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfcb93778954a7f835f51b98669f356)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:04.397910 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:04.445432 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfcb93778954a7f835f51b98669f356'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:04.452626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfcb93778954a7f835f51b98669f356'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:04.453252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfcb93778954a7f835f51b98669f356'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:04.460056 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfcb93778954a7f835f51b98669f356'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:04.460673 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfcb93778954a7f835f51b98669f356'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:04.477254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1351/2677] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:35:04 2022] DELETE /identity/v3/users/acfcb93778954a7f835f51b98669f356 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:04.481677 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:04.482173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:04.482324 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:04.501330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:04.502571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:04.563471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1327/2678] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:04.573657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:04.575054 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:04.632005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703a4d-3a16-4531-9b55-7c69eab4e0fe admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:04.635677 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb3e08-fc1f-4156-a041-b3aea2604f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:04.636275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb3e08-fc1f-4156-a041-b3aea2604f5b service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:04.636603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb3e08-fc1f-4156-a041-b3aea2604f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:04.636887 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb3e08-fc1f-4156-a041-b3aea2604f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:04.645810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb3e08-fc1f-4156-a041-b3aea2604f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:04.647261 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb3e08-fc1f-4156-a041-b3aea2604f5b service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:04.656564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1352/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:04.928945 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:04.930406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:04.945575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9421ab-10f3-46e9-aa34-0e2b64cc3b8a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:04.950478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:04.951178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:04.951490 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:04.951767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] PATH_INFO: `/v3/projects/ab103e6c5473454c9085d335d0735a13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:04.952979 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab103e6c5473454c9085d335d0735a13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:04.955372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.005141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab103e6c5473454c9085d335d0735a13', 'request_id': 'req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:05.012790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab103e6c5473454c9085d335d0735a13', 'request_id': 'req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:05.019083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab103e6c5473454c9085d335d0735a13', 'request_id': 'req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:05.030161 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] The token cache is being invalidate because project ab103e6c5473454c9085d335d0735a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:35:05.030450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:05.031121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ccd07717-3c9c-4b9f-9f27-eb6ac019ae87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:05.032635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1328/2680] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:35:04 2022] DELETE /identity/v3/projects/ab103e6c5473454c9085d335d0735a13 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:05.038428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cbb3e-012b-45d7-91e5-38f3542c4edb None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.038786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cbb3e-012b-45d7-91e5-38f3542c4edb None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.039134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cbb3e-012b-45d7-91e5-38f3542c4edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.073969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-188cbb3e-012b-45d7-91e5-38f3542c4edb None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:05.075342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-188cbb3e-012b-45d7-91e5-38f3542c4edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:05.135495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1353/2681] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:35:05.143417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79ab1a-23fb-4587-9a08-557697185325 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.143772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79ab1a-23fb-4587-9a08-557697185325 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.144115 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79ab1a-23fb-4587-9a08-557697185325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.169523 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-db79ab1a-23fb-4587-9a08-557697185325 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:05.170862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-db79ab1a-23fb-4587-9a08-557697185325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:05.179109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1329/2682] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:05.183427 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cbb3e-012b-45d7-91e5-38f3542c4edb None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.189649 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:05.193488 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cbb3e-012b-45d7-91e5-38f3542c4edb None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.199578 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.200401 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.200876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.201211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.202036 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:35:05.202393 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.204009 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.216293 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1354/2683] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:35:05.220830 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79ab1a-23fb-4587-9a08-557697185325 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.230854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79ab1a-23fb-4587-9a08-557697185325 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.235528 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.236123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.236403 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.236675 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.237304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.239254 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.254593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:05.267515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1330/2684] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:35:05 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:05.272162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.282004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39ccc-fc01-4aca-a681-212ea0f5cb00 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.342124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.342758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.342911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.343184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.343802 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.345695 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.373006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1355/2685] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:35:05 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:05.377140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.388121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666d4c5-b5b5-4982-85dc-78213bbfac1a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.392903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.393495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.393770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.394036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.395344 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.397183 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.407448 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1331/2686] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:05.412118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.422023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e481db-e03b-4e56-b0a5-9a6c456eb5c0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.426568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c180658-f466-4bd5-869e-d3d11e13c79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.427164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180658-f466-4bd5-869e-d3d11e13c79a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.427438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180658-f466-4bd5-869e-d3d11e13c79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.427704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180658-f466-4bd5-869e-d3d11e13c79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.428337 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c180658-f466-4bd5-869e-d3d11e13c79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.429960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c180658-f466-4bd5-869e-d3d11e13c79a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.441132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1356/2687] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:05.445484 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.455525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d23b5-cabf-477a-a6a8-425e30d001ee admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.461475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.462131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.462417 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.462689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] PATH_INFO: `/v3/projects/8fb731c739bd45d3a3172017b3102f57/users/7b8525df01584c9fa6f848a5faf13b80/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.480083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb731c739bd45d3a3172017b3102f57, user_id=7b8525df01584c9fa6f848a5faf13b80, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.482904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.510040 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1332/2688] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:05 2022] PUT /identity/v3/projects/8fb731c739bd45d3a3172017b3102f57/users/7b8525df01584c9fa6f848a5faf13b80/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:05.512008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c9beb-68cf-43e1-b6cd-9f63fd7caaaf None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.512292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c9beb-68cf-43e1-b6cd-9f63fd7caaaf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.512564 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c9beb-68cf-43e1-b6cd-9f63fd7caaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.547675 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ba7c9beb-68cf-43e1-b6cd-9f63fd7caaaf None None] MFA Rules not processed for user `7b8525df01584c9fa6f848a5faf13b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:05.548896 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ba7c9beb-68cf-43e1-b6cd-9f63fd7caaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:05.617624 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1357/2689] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:05.622148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.684908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45e818-b5e9-4b60-a057-f76597716659 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.690007 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.690743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.691588 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.691889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.692525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.694443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.722042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1333/2690] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:35:05 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:05.725652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c9beb-68cf-43e1-b6cd-9f63fd7caaaf None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.736429 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c9beb-68cf-43e1-b6cd-9f63fd7caaaf None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.792746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.793351 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.793630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.793902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.794558 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.796458 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.804264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:05.821168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1358/2691] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:35:05 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:05.825323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.836618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7ea27-e218-4d74-9342-fe948497adf2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.841291 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.841890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.842199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.842472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.843110 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.844729 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.856476 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1334/2692] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:05.864166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.874031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d52da-6231-41e9-89fd-3605468278b9 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.879211 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.879941 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.880219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.880665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] PATH_INFO: `/v3/projects/82e01a652bbd4cb78a5613b9d1598d7d/users/84ac42b20fc1493a88d8d59f755b78c0/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.901603 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e01a652bbd4cb78a5613b9d1598d7d, user_id=84ac42b20fc1493a88d8d59f755b78c0, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.904403 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:05.917796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1359/2693] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:05 2022] PUT /identity/v3/projects/82e01a652bbd4cb78a5613b9d1598d7d/users/84ac42b20fc1493a88d8d59f755b78c0/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:05.921724 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:05.932089 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b5dc9-cf8c-4647-863e-ac3436e41b38 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:05.988849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbbe8b-c3ba-4cd5-8834-4e7072c078bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:05.989597 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbbe8b-c3ba-4cd5-8834-4e7072c078bb admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:05.989870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbbe8b-c3ba-4cd5-8834-4e7072c078bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:05.990167 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbbe8b-c3ba-4cd5-8834-4e7072c078bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:05.990798 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbbe8b-c3ba-4cd5-8834-4e7072c078bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:05.992371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbbe8b-c3ba-4cd5-8834-4e7072c078bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:06.001723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1335/2694] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:06.006674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:06.016721 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b863bc1-60aa-4bef-9d40-81a06aa55961 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:06.021247 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:06.021873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:06.022179 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:06.022448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] PATH_INFO: `/v3/projects/82e01a652bbd4cb78a5613b9d1598d7d/users/84ac42b20fc1493a88d8d59f755b78c0/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:06.024336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e01a652bbd4cb78a5613b9d1598d7d, user_id=84ac42b20fc1493a88d8d59f755b78c0, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:06.026939 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:06.036808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1360/2695] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:06 2022] PUT /identity/v3/projects/82e01a652bbd4cb78a5613b9d1598d7d/users/84ac42b20fc1493a88d8d59f755b78c0/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:06.046712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084ed6e-64fc-4960-9aed-ab3117e963d0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:06.046998 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084ed6e-64fc-4960-9aed-ab3117e963d0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:06.047269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084ed6e-64fc-4960-9aed-ab3117e963d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:06.076684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a084ed6e-64fc-4960-9aed-ab3117e963d0 None None] MFA Rules not processed for user `84ac42b20fc1493a88d8d59f755b78c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:06.077904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a084ed6e-64fc-4960-9aed-ab3117e963d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:06.095968 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:06.148172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1336/2696] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:06.160238 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:06.162191 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:06.219704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0fc88-c353-4d2e-b84b-29fd253e0aaa admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:06.223503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d7556-5834-4e47-9c42-0fb9bfb19375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:06.224107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7556-5834-4e47-9c42-0fb9bfb19375 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:06.224379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7556-5834-4e47-9c42-0fb9bfb19375 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:06.224653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d7556-5834-4e47-9c42-0fb9bfb19375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:06.233829 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7556-5834-4e47-9c42-0fb9bfb19375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:06.235288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d7556-5834-4e47-9c42-0fb9bfb19375 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:06.245769 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1361/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:06.636196 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084ed6e-64fc-4960-9aed-ab3117e963d0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:06.700168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084ed6e-64fc-4960-9aed-ab3117e963d0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:06.704550 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:06.705166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:06.705441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:06.705710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] PATH_INFO: `/v3/users/7b8525df01584c9fa6f848a5faf13b80` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:06.707407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8525df01584c9fa6f848a5faf13b80)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:06.709307 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:06.755104 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8525df01584c9fa6f848a5faf13b80'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:06.755765 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8525df01584c9fa6f848a5faf13b80'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:06.756368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8525df01584c9fa6f848a5faf13b80'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:06.763302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8525df01584c9fa6f848a5faf13b80'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:06.771202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8525df01584c9fa6f848a5faf13b80'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:06.789304 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1337/2698] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:35:06 2022] DELETE /identity/v3/users/7b8525df01584c9fa6f848a5faf13b80 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:06.793823 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:06.794313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:06.794430 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:06.813613 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:06.814847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:06.873325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1362/2699] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:06.883035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:06.884456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:06.924889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:06.944243 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2842867-d2b0-4e76-9602-5ff8c371ca5b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:06.947872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:06.948479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:06.948761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:06.949034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:06.958869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:06.960328 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:06.969970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1338/2700] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:07.264697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:07.266288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:07.296228 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3075e-db4d-4b10-a19e-19251335e930 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:07.301775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:07.302596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:07.302873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:07.303140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] PATH_INFO: `/v3/projects/8fb731c739bd45d3a3172017b3102f57` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:07.304250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb731c739bd45d3a3172017b3102f57)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:07.306245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:07.359187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb731c739bd45d3a3172017b3102f57', 'request_id': 'req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.360544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:07.369064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb731c739bd45d3a3172017b3102f57', 'request_id': 'req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.380743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb731c739bd45d3a3172017b3102f57', 'request_id': 'req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.393443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] The token cache is being invalidate because project 8fb731c739bd45d3a3172017b3102f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:35:07.393738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.394960 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.396676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1363/2701] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:35:07 2022] DELETE /identity/v3/projects/8fb731c739bd45d3a3172017b3102f57 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:07.401817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:07.415909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d2ada-0485-442f-a792-9f2d5137668d service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:07.492852 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:07.493416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:07.493730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:07.494028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] PATH_INFO: `/v3/users/84ac42b20fc1493a88d8d59f755b78c0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:07.496066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ac42b20fc1493a88d8d59f755b78c0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:07.498341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:07.560010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ac42b20fc1493a88d8d59f755b78c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.560683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ac42b20fc1493a88d8d59f755b78c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.561300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ac42b20fc1493a88d8d59f755b78c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.571157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ac42b20fc1493a88d8d59f755b78c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.581108 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c9bf0cca-c19c-46b2-8dba-7e7fbc0aec0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ac42b20fc1493a88d8d59f755b78c0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:07.602295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1339/2702] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:35:07 2022] DELETE /identity/v3/users/84ac42b20fc1493a88d8d59f755b78c0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:07.904372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:07.906103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:07.921125 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfba7a-b42b-42ec-9176-cbdc51b4dd6b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.000563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.001186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.001470 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.001735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] PATH_INFO: `/v3/projects/82e01a652bbd4cb78a5613b9d1598d7d` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.002865 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e01a652bbd4cb78a5613b9d1598d7d)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.005460 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.057808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e01a652bbd4cb78a5613b9d1598d7d', 'request_id': 'req-c28562be-0c1e-4219-9897-c215cd171123'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:08.064923 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e01a652bbd4cb78a5613b9d1598d7d', 'request_id': 'req-c28562be-0c1e-4219-9897-c215cd171123'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:08.072955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e01a652bbd4cb78a5613b9d1598d7d', 'request_id': 'req-c28562be-0c1e-4219-9897-c215cd171123'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:08.084832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] The token cache is being invalidate because project 82e01a652bbd4cb78a5613b9d1598d7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:35:08.085118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:08.085728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-c28562be-0c1e-4219-9897-c215cd171123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:08.087205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1364/2703] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:35:07 2022] DELETE /identity/v3/projects/82e01a652bbd4cb78a5613b9d1598d7d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:08.092873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c162f5-319a-456a-9018-1b3d6a48e1ec None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.093372 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c162f5-319a-456a-9018-1b3d6a48e1ec None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.093482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c162f5-319a-456a-9018-1b3d6a48e1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.113069 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d8c162f5-319a-456a-9018-1b3d6a48e1ec None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:08.114465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d8c162f5-319a-456a-9018-1b3d6a48e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:08.166082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:08.178159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1340/2704] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:08.187184 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e68687-43d9-4105-89ed-85a0d2e0585d None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.187465 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e68687-43d9-4105-89ed-85a0d2e0585d None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.187736 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e68687-43d9-4105-89ed-85a0d2e0585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.209521 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-29e68687-43d9-4105-89ed-85a0d2e0585d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:08.210766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-29e68687-43d9-4105-89ed-85a0d2e0585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:08.219021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1365/2705] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:08.223634 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c162f5-319a-456a-9018-1b3d6a48e1ec None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.233691 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c162f5-319a-456a-9018-1b3d6a48e1ec None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.239043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.239636 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.239914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.240186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.240829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:35:08.241130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.242771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.255123 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1341/2706] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:35:08.259567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e68687-43d9-4105-89ed-85a0d2e0585d None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.268932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e68687-43d9-4105-89ed-85a0d2e0585d None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.273521 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.274138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.274417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.274678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.275292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.277150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.306707 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1366/2707] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:35:08 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:08.311172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.322339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd56fb5-2b3f-48ce-9bf2-c1465050b115 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.387024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.387635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.387914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.388184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.388821 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.390759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.413409 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1342/2708] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:35:08 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:08.417626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.429080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0571b5-3f28-4567-b05a-6f0e61bb5c9c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.433752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.434386 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.434667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.434965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.435604 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.437194 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.449284 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1367/2709] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:08.453783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.464827 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0753fe-d9d2-4a74-8ba2-d706e3d72eb5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.470469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096757c-4254-4fe9-81a4-d2abdd3e657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.470972 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096757c-4254-4fe9-81a4-d2abdd3e657c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.471395 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096757c-4254-4fe9-81a4-d2abdd3e657c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.471887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096757c-4254-4fe9-81a4-d2abdd3e657c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.473450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096757c-4254-4fe9-81a4-d2abdd3e657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.475106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096757c-4254-4fe9-81a4-d2abdd3e657c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.486733 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1343/2710] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:08.491544 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.502013 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d1310-d27d-4d19-8236-604696fdf251 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.508015 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.508838 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.509245 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.509530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] PATH_INFO: `/v3/projects/b4fd8c1d11ea4e52a96aab5988d560be/users/470e185e57f0455588901a68670eb677/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.526072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fd8c1d11ea4e52a96aab5988d560be, user_id=470e185e57f0455588901a68670eb677, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.528816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.541798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1368/2711] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:08 2022] PUT /identity/v3/projects/b4fd8c1d11ea4e52a96aab5988d560be/users/470e185e57f0455588901a68670eb677/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:35:08.554327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a07dc-3000-4ee0-87ea-8fa75f0c9593 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.554696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a07dc-3000-4ee0-87ea-8fa75f0c9593 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.555026 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a07dc-3000-4ee0-87ea-8fa75f0c9593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.584378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1b7a07dc-3000-4ee0-87ea-8fa75f0c9593 None None] MFA Rules not processed for user `470e185e57f0455588901a68670eb677`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:08.585575 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1b7a07dc-3000-4ee0-87ea-8fa75f0c9593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:08.652665 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1344/2712] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:35:08.657569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.663680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:08.727047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a742a4d-1fd1-45bf-b4d5-123012406623 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.731859 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.732479 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.732756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.733021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.733637 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.735718 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.767893 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1369/2713] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:35:08 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:08.769951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a07dc-3000-4ee0-87ea-8fa75f0c9593 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.780609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a07dc-3000-4ee0-87ea-8fa75f0c9593 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.843155 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:08.856824 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.857444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.857722 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.857991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.858679 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.860632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.889262 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1345/2714] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:35:08 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:08.890855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.903133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033868c-55ae-43df-9f02-895952a127ca admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.909187 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.910531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.910531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.910531 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.911066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.912662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.923499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1370/2715] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:08.928450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.939047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0469ef-2986-4e8b-834e-4933a6ee5f78 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:08.944850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:08.945602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:08.945887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:08.946350 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] PATH_INFO: `/v3/projects/609c08fd3764468e8dcef96bc6488844/users/0cd3bc43df884e33bbbe46e732b17aa4/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:08.963112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609c08fd3764468e8dcef96bc6488844, user_id=0cd3bc43df884e33bbbe46e732b17aa4, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:08.965776 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:08.979813 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1346/2716] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:08 2022] PUT /identity/v3/projects/609c08fd3764468e8dcef96bc6488844/users/0cd3bc43df884e33bbbe46e732b17aa4/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:08.983902 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:08.997418 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74fc7-e77f-4e14-aca5-42f3259ef88f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:09.063670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcdc84-7b5b-4d78-bf67-b6ce717eb813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:09.065190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcdc84-7b5b-4d78-bf67-b6ce717eb813 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:09.065627 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcdc84-7b5b-4d78-bf67-b6ce717eb813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:09.067549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcdc84-7b5b-4d78-bf67-b6ce717eb813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:09.068385 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcdc84-7b5b-4d78-bf67-b6ce717eb813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:09.070951 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcdc84-7b5b-4d78-bf67-b6ce717eb813 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:09.096752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1371/2717] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:09.101077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:09.111557 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dfc07-2aa5-4963-b03d-d226d4aef613 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:09.117649 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:09.118541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:09.118825 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:09.119106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] PATH_INFO: `/v3/projects/609c08fd3764468e8dcef96bc6488844/users/0cd3bc43df884e33bbbe46e732b17aa4/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:09.121600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609c08fd3764468e8dcef96bc6488844, user_id=0cd3bc43df884e33bbbe46e732b17aa4, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:09.124320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:09.136686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1347/2718] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:09 2022] PUT /identity/v3/projects/609c08fd3764468e8dcef96bc6488844/users/0cd3bc43df884e33bbbe46e732b17aa4/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:09.147435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444affd2-9c8e-48cf-a2ab-f47f63307885 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:09.147731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444affd2-9c8e-48cf-a2ab-f47f63307885 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:09.148053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444affd2-9c8e-48cf-a2ab-f47f63307885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:09.177302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-444affd2-9c8e-48cf-a2ab-f47f63307885 None None] MFA Rules not processed for user `0cd3bc43df884e33bbbe46e732b17aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:09.178560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-444affd2-9c8e-48cf-a2ab-f47f63307885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:09.255016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:09.261875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1372/2719] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:09.273018 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:09.274806 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:09.352072 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01367-be29-4630-8029-99e6506c7c42 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:09.356881 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330233d9-82b6-4c58-b1f7-6caebcc30148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:09.357454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330233d9-82b6-4c58-b1f7-6caebcc30148 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:09.357732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330233d9-82b6-4c58-b1f7-6caebcc30148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:09.358134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330233d9-82b6-4c58-b1f7-6caebcc30148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:09.370551 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330233d9-82b6-4c58-b1f7-6caebcc30148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:09.371995 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330233d9-82b6-4c58-b1f7-6caebcc30148 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:09.382124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1348/2720] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:11.093567 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444affd2-9c8e-48cf-a2ab-f47f63307885 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:11.159161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444affd2-9c8e-48cf-a2ab-f47f63307885 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:11.164513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:11.165168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:11.165442 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:11.165709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] PATH_INFO: `/v3/users/470e185e57f0455588901a68670eb677` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:11.166847 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470e185e57f0455588901a68670eb677)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:11.168741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:11.234408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470e185e57f0455588901a68670eb677'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:11.247986 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470e185e57f0455588901a68670eb677'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:11.252770 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470e185e57f0455588901a68670eb677'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:11.258609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470e185e57f0455588901a68670eb677'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:11.259320 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470e185e57f0455588901a68670eb677'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:11.285389 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1373/2721] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:35:11 2022] DELETE /identity/v3/users/470e185e57f0455588901a68670eb677 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:11.289882 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:11.290383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:11.290654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:11.318787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:11.320039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:11.384916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1349/2722] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:35:11.396209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:11.397862 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:11.460425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b351b-ed71-4c48-b1f2-fdb4755e36e3 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:11.473402 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:11.474085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:11.474443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:11.474805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:11.485306 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:11.486875 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:11.498120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1374/2723] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:12.234046 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:12.235570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:12.250491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3b32b-6f3d-441e-a54b-48c95f2c3ec4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:12.257797 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:12.258773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:12.259257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:12.259795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] PATH_INFO: `/v3/projects/b4fd8c1d11ea4e52a96aab5988d560be` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:12.261286 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fd8c1d11ea4e52a96aab5988d560be)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:12.263529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:12.322035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:12.328356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fd8c1d11ea4e52a96aab5988d560be', 'request_id': 'req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.338699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fd8c1d11ea4e52a96aab5988d560be', 'request_id': 'req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.352150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fd8c1d11ea4e52a96aab5988d560be', 'request_id': 'req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.368224 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] The token cache is being invalidate because project b4fd8c1d11ea4e52a96aab5988d560be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:35:12.368524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.369175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.370686 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1350/2724] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:35:12 2022] DELETE /identity/v3/projects/b4fd8c1d11ea4e52a96aab5988d560be => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:12.374660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:12.384509 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb696017-2eed-4061-9695-8b31294e4970 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:12.404263 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:12.454426 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:12.455136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:12.455473 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:12.455811 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] PATH_INFO: `/v3/users/0cd3bc43df884e33bbbe46e732b17aa4` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:12.457088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd3bc43df884e33bbbe46e732b17aa4)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:12.459489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:12.511688 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd3bc43df884e33bbbe46e732b17aa4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.520113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd3bc43df884e33bbbe46e732b17aa4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.521358 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd3bc43df884e33bbbe46e732b17aa4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.528754 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd3bc43df884e33bbbe46e732b17aa4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.529411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-4e48d599-695a-49ea-9438-0eb88964f33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd3bc43df884e33bbbe46e732b17aa4'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:12.548888 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1375/2725] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:35:12 2022] DELETE /identity/v3/users/0cd3bc43df884e33bbbe46e732b17aa4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:35:12.865102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:12.866556 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:12.879742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4b4a7-93a7-44cf-a71d-da2a21e24ee9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:12.941368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:12.942378 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:12.942662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:12.942951 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] PATH_INFO: `/v3/projects/609c08fd3764468e8dcef96bc6488844` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:12.945662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609c08fd3764468e8dcef96bc6488844)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:12.948445 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:12.995931 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609c08fd3764468e8dcef96bc6488844', 'request_id': 'req-4b125163-4998-4665-9cac-6bba2092ae43'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:13.004909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609c08fd3764468e8dcef96bc6488844', 'request_id': 'req-4b125163-4998-4665-9cac-6bba2092ae43'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:13.012008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609c08fd3764468e8dcef96bc6488844', 'request_id': 'req-4b125163-4998-4665-9cac-6bba2092ae43'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:13.024817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] The token cache is being invalidate because project 609c08fd3764468e8dcef96bc6488844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:35:13.025121 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:13.025775 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4b125163-4998-4665-9cac-6bba2092ae43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:13.027652 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1351/2726] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:35:12 2022] DELETE /identity/v3/projects/609c08fd3764468e8dcef96bc6488844 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:13.032474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aa76a-2641-40c8-9994-62dbf7878601 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.032979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aa76a-2641-40c8-9994-62dbf7878601 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.033254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120aa76a-2641-40c8-9994-62dbf7878601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.053591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-120aa76a-2641-40c8-9994-62dbf7878601 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:13.054833 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-120aa76a-2641-40c8-9994-62dbf7878601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:13.119462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1376/2727] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:13.129259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6679c79-2ed7-4d24-aa81-96252b0745ed None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.129580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6679c79-2ed7-4d24-aa81-96252b0745ed None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.129826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6679c79-2ed7-4d24-aa81-96252b0745ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.151471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b6679c79-2ed7-4d24-aa81-96252b0745ed None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:13.152698 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b6679c79-2ed7-4d24-aa81-96252b0745ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:13.161015 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1352/2728] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:35:13.165352 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aa76a-2641-40c8-9994-62dbf7878601 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:13.176203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120aa76a-2641-40c8-9994-62dbf7878601 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:13.181507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:13.182185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.182667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.182814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.183362 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:35:13.183815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:13.185464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:13.201030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1377/2729] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:35:13.205343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6679c79-2ed7-4d24-aa81-96252b0745ed None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:13.215454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6679c79-2ed7-4d24-aa81-96252b0745ed None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:13.222635 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:13.223245 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.223522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.223792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.224437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:13.226351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:13.255114 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1353/2730] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:35:13 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:35:13.259523 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:13.270171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879dea0-5ceb-4cfa-bb5e-fd373c6f53f0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:13.295922 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:13.329267 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:13.329881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.330188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.330463 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.331798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:13.333961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:13.360398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1378/2731] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:35:13 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:13.361511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:13.374639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320c26-b5ba-4b91-9c19-32f23ab3014a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:13.379924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:13.380527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.380807 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.381077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.381714 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:13.383341 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:13.397134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1354/2732] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:13.398336 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:13.409507 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b835044-9d68-4248-b11a-a25e267aff07 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:13.414265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e28d0-f0a2-41e3-99bd-db90c582ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:13.414883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e28d0-f0a2-41e3-99bd-db90c582ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.415157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e28d0-f0a2-41e3-99bd-db90c582ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.415424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e28d0-f0a2-41e3-99bd-db90c582ef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.416083 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e28d0-f0a2-41e3-99bd-db90c582ef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:13.417678 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e28d0-f0a2-41e3-99bd-db90c582ef6a admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:13.429295 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1379/2733] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:13.433624 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:13.444610 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4c565-105c-4d36-aadb-971d2a83abf8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:13.449302 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:13.449949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.450270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.450546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] PATH_INFO: `/v3/projects/624598b5e6064873a339798eebf390f9/users/840a0e774c994633a63187ebf47c219b/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.464912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624598b5e6064873a339798eebf390f9, user_id=840a0e774c994633a63187ebf47c219b, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:13.467515 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:13.476416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:13.482631 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1355/2734] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:13 2022] PUT /identity/v3/projects/624598b5e6064873a339798eebf390f9/users/840a0e774c994633a63187ebf47c219b/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:35:13.493711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c55528-8c5d-4f44-ba17-40c61c263495 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.494072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c55528-8c5d-4f44-ba17-40c61c263495 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.494394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c55528-8c5d-4f44-ba17-40c61c263495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.523124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d2c55528-8c5d-4f44-ba17-40c61c263495 None None] MFA Rules not processed for user `840a0e774c994633a63187ebf47c219b`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:13.524319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d2c55528-8c5d-4f44-ba17-40c61c263495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:13.589515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1380/2735] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:13.601713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:13.603418 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:13.662926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d33ac1-e78c-467d-a3f7-49f4918e3341 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:13.666585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fd369-7550-4776-9b0f-296526d5ecee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:13.667188 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fd369-7550-4776-9b0f-296526d5ecee service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:13.667462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fd369-7550-4776-9b0f-296526d5ecee service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:13.667730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fd369-7550-4776-9b0f-296526d5ecee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:13.676900 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fd369-7550-4776-9b0f-296526d5ecee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:13.678327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fd369-7550-4776-9b0f-296526d5ecee service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:13.687396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1356/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:19.525086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:19.525594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:19.525693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:19.545501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] MFA Rules not processed for user `7a28576fcbc34c0f9dda76e8b390928a`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:19.546716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:19.601318 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1381/2737] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:23.683385 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=27 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:23.978303 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802032ae-99c7-483a-98f6-b7ba16051a92 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:23.978615 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802032ae-99c7-483a-98f6-b7ba16051a92 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:23.978895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802032ae-99c7-483a-98f6-b7ba16051a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:24.001209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-802032ae-99c7-483a-98f6-b7ba16051a92 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:24.002508 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-802032ae-99c7-483a-98f6-b7ba16051a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:24.079438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1357/2738] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:24.101188 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:24.102767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:24.167911 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:24.206134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1545dd-2f92-43b8-94f1-e959266eac7a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:24.213819 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc302ec-0d48-45d4-838c-fabdad6aecfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:24.214483 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc302ec-0d48-45d4-838c-fabdad6aecfc service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:24.214936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc302ec-0d48-45d4-838c-fabdad6aecfc service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:24.215208 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc302ec-0d48-45d4-838c-fabdad6aecfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:24.225863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc302ec-0d48-45d4-838c-fabdad6aecfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:24.227711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc302ec-0d48-45d4-838c-fabdad6aecfc service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:24.241138 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1382/2739] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:25.459891 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802032ae-99c7-483a-98f6-b7ba16051a92 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:25.469529 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802032ae-99c7-483a-98f6-b7ba16051a92 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:25.474400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:25.475022 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:25.475296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:25.475565 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] PATH_INFO: `/v3/users/840a0e774c994633a63187ebf47c219b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:25.476668 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=840a0e774c994633a63187ebf47c219b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:25.478633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:25.525828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840a0e774c994633a63187ebf47c219b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:25.526498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840a0e774c994633a63187ebf47c219b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:25.527093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840a0e774c994633a63187ebf47c219b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:25.534242 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840a0e774c994633a63187ebf47c219b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:25.541738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840a0e774c994633a63187ebf47c219b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:25.559661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1358/2740] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:35:25 2022] DELETE /identity/v3/users/840a0e774c994633a63187ebf47c219b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:25.564354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:25.564809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:25.564944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:25.584123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:25.585335 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:25.643717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1383/2741] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:25.653569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:25.654974 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:25.720137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84bbe6-cc42-4394-b091-36ff793a22bf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:25.724315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eabc4-cf51-43dc-8dc0-f1bd87381108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:25.724919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eabc4-cf51-43dc-8dc0-f1bd87381108 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:25.725191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eabc4-cf51-43dc-8dc0-f1bd87381108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:25.725487 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eabc4-cf51-43dc-8dc0-f1bd87381108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:25.734577 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eabc4-cf51-43dc-8dc0-f1bd87381108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:25.735985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8eabc4-cf51-43dc-8dc0-f1bd87381108 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:25.746042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1359/2742] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:26.021249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.023399 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:26.037105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb047c32-026a-4ad3-8d40-ad46f6387848 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.042662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.045594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.045594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.045594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] PATH_INFO: `/v3/projects/624598b5e6064873a339798eebf390f9` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.046268 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=624598b5e6064873a339798eebf390f9)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.048157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.100022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624598b5e6064873a339798eebf390f9', 'request_id': 'req-fb5add35-5be2-4814-85ff-98547a10c8c1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:26.115614 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624598b5e6064873a339798eebf390f9', 'request_id': 'req-fb5add35-5be2-4814-85ff-98547a10c8c1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:26.125491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624598b5e6064873a339798eebf390f9', 'request_id': 'req-fb5add35-5be2-4814-85ff-98547a10c8c1'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:26.139616 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] The token cache is being invalidate because project 624598b5e6064873a339798eebf390f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:35:26.139897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:26.141041 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-fb5add35-5be2-4814-85ff-98547a10c8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:35:26.142775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1384/2743] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:35:26 2022] DELETE /identity/v3/projects/624598b5e6064873a339798eebf390f9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:35:26.147750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704de06d-2c54-43c8-b279-9aafdf59a26f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.148041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704de06d-2c54-43c8-b279-9aafdf59a26f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.148320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704de06d-2c54-43c8-b279-9aafdf59a26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.180871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-704de06d-2c54-43c8-b279-9aafdf59a26f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:26.182225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-704de06d-2c54-43c8-b279-9aafdf59a26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:26.192826 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:26.247010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1360/2744] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:26.256551 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab5f3-26ea-4a5c-8875-f4fa19373fdf None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.256860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab5f3-26ea-4a5c-8875-f4fa19373fdf None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.257130 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ab5f3-26ea-4a5c-8875-f4fa19373fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.277307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-d80ab5f3-26ea-4a5c-8875-f4fa19373fdf None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:26.278540 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-d80ab5f3-26ea-4a5c-8875-f4fa19373fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:26.286302 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1385/2745] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:26.290763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704de06d-2c54-43c8-b279-9aafdf59a26f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.301175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704de06d-2c54-43c8-b279-9aafdf59a26f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.305585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.306223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.306507 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.306782 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.307424 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:35:26.307727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.309325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.321600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1361/2746] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:35:26.325796 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ab5f3-26ea-4a5c-8875-f4fa19373fdf None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.336503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ab5f3-26ea-4a5c-8875-f4fa19373fdf None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.342283 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.342882 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.343150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.343412 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.344329 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.347895 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.378178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1386/2747] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:35:26 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:35:26.383994 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.394072 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868f0c-25a9-4cec-80d4-7a5a9bf0f235 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.454805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.455406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.455685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.455959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.456710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.458892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.480263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1362/2748] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:35:26 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:35:26.484415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.495889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3b8d8-a621-4b32-92f2-0c4b618945ec admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.500435 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.501020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.501296 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.501566 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.502236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.504384 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.514073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1387/2749] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:26.517869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.528232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451375a6-eddc-4645-9a92-20dabcbe0550 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.532777 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c1627-c3e8-4aac-8bcd-1673e57e034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.533366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1627-c3e8-4aac-8bcd-1673e57e034e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.533643 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1627-c3e8-4aac-8bcd-1673e57e034e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.533914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c1627-c3e8-4aac-8bcd-1673e57e034e admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.535113 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1627-c3e8-4aac-8bcd-1673e57e034e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.537187 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c1627-c3e8-4aac-8bcd-1673e57e034e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.547633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1363/2750] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:35:26.552294 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.562361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014bcfe-f415-4b77-a78a-0076e404c799 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.567117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.567743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.568021 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.568297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] PATH_INFO: `/v3/projects/366b8536d40f4e2682a79acc8fde9114/users/cbf284a3161c44a792b0b307173b46ae/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.576693 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:26.584955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=366b8536d40f4e2682a79acc8fde9114, user_id=cbf284a3161c44a792b0b307173b46ae, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.588032 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.601086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1388/2751] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:35:26 2022] PUT /identity/v3/projects/366b8536d40f4e2682a79acc8fde9114/users/cbf284a3161c44a792b0b307173b46ae/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:35:26.606175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1106-5aa8-4521-bf1c-075ab4555d6d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.606456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1106-5aa8-4521-bf1c-075ab4555d6d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.606725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a1106-5aa8-4521-bf1c-075ab4555d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.625542 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e56a1106-5aa8-4521-bf1c-075ab4555d6d None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:26.626753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e56a1106-5aa8-4521-bf1c-075ab4555d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:26.687688 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1364/2752] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:26.697501 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:26.699213 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:26.759431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc015001-3f7e-4878-b05f-fef1e28d74c0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:26.763151 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:26.763751 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.764025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.764292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:26.773969 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:26.775506 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:26.785760 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1389/2753] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:26.997646 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901550-169e-4ed6-9c7f-acae0acc121b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:26.997928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901550-169e-4ed6-9c7f-acae0acc121b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:26.998233 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33901550-169e-4ed6-9c7f-acae0acc121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:27.018356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-33901550-169e-4ed6-9c7f-acae0acc121b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:27.020276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-33901550-169e-4ed6-9c7f-acae0acc121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:27.029365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1365/2754] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:27.043685 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:27.045133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:27.147199 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ae009-7e76-4606-84ba-e8a4060bac0d service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:27.152920 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:27.153583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:27.154457 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:27.154741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:27.164081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:27.165670 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:27.176448 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1390/2755] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:27.459288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afe4f2-9429-4d6a-a6bd-44be5f213cfc None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:27.459580 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afe4f2-9429-4d6a-a6bd-44be5f213cfc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:27.459841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afe4f2-9429-4d6a-a6bd-44be5f213cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:27.488935 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b3afe4f2-9429-4d6a-a6bd-44be5f213cfc None None] MFA Rules not processed for user `cbf284a3161c44a792b0b307173b46ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:27.490172 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b3afe4f2-9429-4d6a-a6bd-44be5f213cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:27.494032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:27.557524 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1366/2756] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:27.569975 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:27.571508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:27.642280 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983961a4-9e27-42ea-875f-45cf4f6d3d0c service nova] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:27.646561 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343159cc-2e50-4d50-8c66-0f01642666ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:27.647168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343159cc-2e50-4d50-8c66-0f01642666ea service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:27.647639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343159cc-2e50-4d50-8c66-0f01642666ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:27.647817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343159cc-2e50-4d50-8c66-0f01642666ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:27.657555 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343159cc-2e50-4d50-8c66-0f01642666ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:27.659018 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343159cc-2e50-4d50-8c66-0f01642666ea service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:27.668079 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1391/2757] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:29.047839 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651f3e0-e23c-4728-9956-7d15844c0f31 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:29.048330 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651f3e0-e23c-4728-9956-7d15844c0f31 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:29.048452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651f3e0-e23c-4728-9956-7d15844c0f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:29.069603 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4651f3e0-e23c-4728-9956-7d15844c0f31 None None] MFA Rules not processed for user `cbf284a3161c44a792b0b307173b46ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:29.070855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4651f3e0-e23c-4728-9956-7d15844c0f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:29.078080 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1367/2758] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:30.283309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da01ab-beea-438b-91b5-3466a5d3f31a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:30.283855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da01ab-beea-438b-91b5-3466a5d3f31a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:30.283855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da01ab-beea-438b-91b5-3466a5d3f31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:30.305249 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a5da01ab-beea-438b-91b5-3466a5d3f31a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:30.306569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a5da01ab-beea-438b-91b5-3466a5d3f31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:30.316696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1392/2759] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:35:30.334150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651f3e0-e23c-4728-9956-7d15844c0f31 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:30.347258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651f3e0-e23c-4728-9956-7d15844c0f31 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:30.352751 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:30.353370 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:30.353639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:30.353910 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:30.363654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:30.365251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:30.376630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1368/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:33.394505 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4003-4686-44f6-b075-cc9310892511 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:33.395073 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4003-4686-44f6-b075-cc9310892511 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:33.395300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e4003-4686-44f6-b075-cc9310892511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:33.414876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-fc4e4003-4686-44f6-b075-cc9310892511 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:33.416171 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-fc4e4003-4686-44f6-b075-cc9310892511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:33.424145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1393/2761] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:33.439933 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:33.455851 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14713ba-16e5-4afc-94ff-e03df2f69ebe service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:33.462078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:33.462784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:33.463133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:33.463480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:33.472083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:33.473664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:33.483394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1369/2762] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:36.552712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab3d1-14b2-41d0-a172-efbf16c253f8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:36.553224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab3d1-14b2-41d0-a172-efbf16c253f8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:36.553224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab3d1-14b2-41d0-a172-efbf16c253f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:36.562656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:36.574344 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-e01ab3d1-14b2-41d0-a172-efbf16c253f8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:36.575626 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e01ab3d1-14b2-41d0-a172-efbf16c253f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:36.585668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1394/2763] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:36.615397 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:36.626727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c55e8-1682-46e7-8d38-0fe121c0f026 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:36.635158 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:36.635866 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:36.636217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:36.636684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:36.650617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:36.652264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:36.668902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1370/2764] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:39.717356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38fcb0-599f-4870-8bd8-1497a07c7876 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:39.717824 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38fcb0-599f-4870-8bd8-1497a07c7876 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:39.718133 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38fcb0-599f-4870-8bd8-1497a07c7876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:39.738404 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9b38fcb0-599f-4870-8bd8-1497a07c7876 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:39.739686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9b38fcb0-599f-4870-8bd8-1497a07c7876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:39.749051 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1395/2765] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:39.764904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:35:39.778611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a340dee-600b-4a63-9e09-d343de6e7e02 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:35:39.784850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469a44-6d5e-4a32-906c-9cd8e5bc1d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:35:39.785502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469a44-6d5e-4a32-906c-9cd8e5bc1d5b service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:39.785784 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469a44-6d5e-4a32-906c-9cd8e5bc1d5b service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:39.786100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469a44-6d5e-4a32-906c-9cd8e5bc1d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:39.794970 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469a44-6d5e-4a32-906c-9cd8e5bc1d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:35:39.796560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469a44-6d5e-4a32-906c-9cd8e5bc1d5b service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:35:39.806526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1371/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:35:49.732856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:49.802035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=52 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:35:51.241944 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2e7a-f54c-4c24-8520-aa7bc2459d96 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:51.242869 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2e7a-f54c-4c24-8520-aa7bc2459d96 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:51.243325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2e7a-f54c-4c24-8520-aa7bc2459d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:51.264766 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-461a2e7a-f54c-4c24-8520-aa7bc2459d96 None None] MFA Rules not processed for user `cbf284a3161c44a792b0b307173b46ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:51.265965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-461a2e7a-f54c-4c24-8520-aa7bc2459d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:51.273570 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1396/2767] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:35:56.031042 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:35:56.031583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:35:56.031583 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:35:56.050129 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] MFA Rules not processed for user `73d9d4215ca84114a2b246995aec3dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:35:56.051327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:35:56.107510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1372/2768] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:35:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:01.257681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:06.100862 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=25 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:07.870205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c96d7-bd90-4f58-a1b0-154d60737c7c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:07.870728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c96d7-bd90-4f58-a1b0-154d60737c7c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:07.870728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c96d7-bd90-4f58-a1b0-154d60737c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:07.890147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a56c96d7-bd90-4f58-a1b0-154d60737c7c None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:07.892085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a56c96d7-bd90-4f58-a1b0-154d60737c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:07.900480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1397/2769] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:07.918743 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:07.920278 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:07.936837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a980154-fc90-443f-b34a-1e2cc8043b34 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:07.942609 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:07.943209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:07.943488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:07.943756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:07.951835 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:07.953399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:07.963654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1373/2770] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:36:08.381212 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb635-c07f-4bab-b8a9-6e09e86e2088 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:08.381499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb635-c07f-4bab-b8a9-6e09e86e2088 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:08.381773 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bb635-c07f-4bab-b8a9-6e09e86e2088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:08.401425 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-be5bb635-c07f-4bab-b8a9-6e09e86e2088 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:08.402643 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-be5bb635-c07f-4bab-b8a9-6e09e86e2088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:08.459020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1398/2771] 10.222.0.18 () {58 vars in 1009 bytes} [Fri Sep 30 19:36:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:08.504939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:08.506399 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:08.576315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c196-692d-45ba-930b-afa1e5cdaddf service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:08.581379 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:08.581981 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:08.582288 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:08.582560 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:08.590488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:08.592047 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:08.600269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1374/2772] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:36:11.146234 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11b0b-1a90-4b8d-ad01-fbba4881d5b4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:11.146957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11b0b-1a90-4b8d-ad01-fbba4881d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:11.146957 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f11b0b-1a90-4b8d-ad01-fbba4881d5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:11.169392 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f6f11b0b-1a90-4b8d-ad01-fbba4881d5b4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:11.170715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f6f11b0b-1a90-4b8d-ad01-fbba4881d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:11.179771 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1399/2773] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:36:11.195174 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:11.219639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d56b45-de96-44b3-9c3a-1ca83cafdea5 service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:11.226432 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:11.227275 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:11.227653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:11.228027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:11.241892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:11.241892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:11.256144 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1375/2774] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:36:14.223649 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809313-0b96-498e-90df-a0011b8b5e0f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:14.224315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809313-0b96-498e-90df-a0011b8b5e0f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:14.224315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15809313-0b96-498e-90df-a0011b8b5e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:14.247668 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-15809313-0b96-498e-90df-a0011b8b5e0f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:14.249411 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-15809313-0b96-498e-90df-a0011b8b5e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:14.260529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1400/2775] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:14.275908 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:14.296173 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc4f72-dd08-449f-b799-47afeb29d4c1 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:14.308133 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:14.309522 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:14.310266 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:14.310626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:14.321639 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:14.323264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:14.336762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1376/2776] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:36:17.455451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422d5f1-6591-44d4-8cc0-af2f30e87b1e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:17.455987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422d5f1-6591-44d4-8cc0-af2f30e87b1e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:17.455987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422d5f1-6591-44d4-8cc0-af2f30e87b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:17.488873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-9422d5f1-6591-44d4-8cc0-af2f30e87b1e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:17.490141 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-9422d5f1-6591-44d4-8cc0-af2f30e87b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:17.498642 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1401/2777] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:17.517651 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:17.530083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7193-976d-453c-a0b6-1383f5ba24e8 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:17.537491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:17.538190 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:17.538472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:17.538742 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:17.548717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:17.550661 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:17.577339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1377/2778] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:36:21.738017 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d8e1e-d5d6-47e6-add8-5c4ba2404aab None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:21.738827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d8e1e-d5d6-47e6-add8-5c4ba2404aab None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:21.738827 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d8e1e-d5d6-47e6-add8-5c4ba2404aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:21.769374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-945d8e1e-d5d6-47e6-add8-5c4ba2404aab None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:21.772725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-945d8e1e-d5d6-47e6-add8-5c4ba2404aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:21.783086 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1402/2779] 10.222.0.39 () {58 vars in 1016 bytes} [Fri Sep 30 19:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:36:21.815950 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:21.829892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039f726-ddc9-45ff-886f-ef5fe331eb2b service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:21.848400 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec374bb-8221-4746-b27b-7613b1775544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57667fb21646457b8871087abcbd978c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:21.849638 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec374bb-8221-4746-b27b-7613b1775544 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:21.850092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec374bb-8221-4746-b27b-7613b1775544 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:21.850754 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec374bb-8221-4746-b27b-7613b1775544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:21.866906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec374bb-8221-4746-b27b-7613b1775544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:21.868819 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec374bb-8221-4746-b27b-7613b1775544 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:21.881455 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1378/2780] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:36:24.572844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e3d0-fa75-4344-9b26-a688c85693d7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:24.573353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e3d0-fa75-4344-9b26-a688c85693d7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:24.573462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24e3d0-fa75-4344-9b26-a688c85693d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:24.591858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-1f24e3d0-fa75-4344-9b26-a688c85693d7 None None] MFA Rules not processed for user `7a28576fcbc34c0f9dda76e8b390928a`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:24.593657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1f24e3d0-fa75-4344-9b26-a688c85693d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:24.646692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1403/2781] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:36:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:25.178300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6895c8d-967e-43b8-9396-d8cde1dfb265 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:25.179241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6895c8d-967e-43b8-9396-d8cde1dfb265 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:25.179655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6895c8d-967e-43b8-9396-d8cde1dfb265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:25.214142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d6895c8d-967e-43b8-9396-d8cde1dfb265 None None] MFA Rules not processed for user `a2d7f47c973449069def6cc121df83f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:25.215491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d6895c8d-967e-43b8-9396-d8cde1dfb265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:25.269987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1379/2782] 10.222.0.18 () {58 vars in 967 bytes} [Fri Sep 30 19:36:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:25.282400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e3d0-fa75-4344-9b26-a688c85693d7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:25.324096 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24e3d0-fa75-4344-9b26-a688c85693d7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:25.330660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2975430fac884ff89b88b9fe1b76cb30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:25.331343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:25.331696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:25.332053 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:25.341899 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:25.343955 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:25.353775 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1404/2783] 10.222.0.18 () {60 vars in 1384 bytes} [Fri Sep 30 19:36:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 30 19:36:27.409858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6895c8d-967e-43b8-9396-d8cde1dfb265 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:27.443159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6895c8d-967e-43b8-9396-d8cde1dfb265 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:27.447595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:27.448209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:27.448482 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:27.448750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] PATH_INFO: `/v3/users/cbf284a3161c44a792b0b307173b46ae` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:27.450028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf284a3161c44a792b0b307173b46ae)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:27.451948 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:27.473850 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:27.498999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf284a3161c44a792b0b307173b46ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.499992 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf284a3161c44a792b0b307173b46ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.500463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf284a3161c44a792b0b307173b46ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.507846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf284a3161c44a792b0b307173b46ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.517352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5792b6da-2801-4270-9e63-927dd9d7c26a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf284a3161c44a792b0b307173b46ae'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.535920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1380/2784] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:36:27 2022] DELETE /identity/v3/users/cbf284a3161c44a792b0b307173b46ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:36:27.762471 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:27.780323 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcceffa-23f2-4cee-a71a-a2a963794ebd service swift] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:27.819356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:27.840095 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:27.840777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:27.841057 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:27.841330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] PATH_INFO: `/v3/projects/366b8536d40f4e2682a79acc8fde9114` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:27.842469 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=366b8536d40f4e2682a79acc8fde9114)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:27.844723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:27.891217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366b8536d40f4e2682a79acc8fde9114', 'request_id': 'req-39a83b7d-91ab-4f91-aac5-287a32958aea'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.897154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366b8536d40f4e2682a79acc8fde9114', 'request_id': 'req-39a83b7d-91ab-4f91-aac5-287a32958aea'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.903667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366b8536d40f4e2682a79acc8fde9114', 'request_id': 'req-39a83b7d-91ab-4f91-aac5-287a32958aea'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.926205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] The token cache is being invalidate because project 366b8536d40f4e2682a79acc8fde9114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:36:27.926491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.927107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-39a83b7d-91ab-4f91-aac5-287a32958aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:27.928554 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1405/2785] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:36:27 2022] DELETE /identity/v3/projects/366b8536d40f4e2682a79acc8fde9114 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:36:27.933366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c203-4bdd-4006-93d9-2ae6599a95a1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:27.933654 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c203-4bdd-4006-93d9-2ae6599a95a1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:27.933928 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c203-4bdd-4006-93d9-2ae6599a95a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:27.990849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fbf5c203-4bdd-4006-93d9-2ae6599a95a1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:27.991959 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fbf5c203-4bdd-4006-93d9-2ae6599a95a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:28.049053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1381/2786] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:28.056787 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ebbf6-8e59-424b-acaa-1db344cedcb5 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.057072 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ebbf6-8e59-424b-acaa-1db344cedcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.057382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ebbf6-8e59-424b-acaa-1db344cedcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.077589 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-0e5ebbf6-8e59-424b-acaa-1db344cedcb5 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:28.079400 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-0e5ebbf6-8e59-424b-acaa-1db344cedcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:28.087134 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1406/2787] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:28.091276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c203-4bdd-4006-93d9-2ae6599a95a1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:28.101059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c203-4bdd-4006-93d9-2ae6599a95a1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:28.105553 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:28.106169 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.106444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.106711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.107346 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:36:28.107644 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:28.109853 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:28.121092 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1382/2788] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:36:28.126244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ebbf6-8e59-424b-acaa-1db344cedcb5 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:28.135126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ebbf6-8e59-424b-acaa-1db344cedcb5 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:28.139723 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:28.140354 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.140863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.141162 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.141786 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:28.143697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:28.170120 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1407/2789] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:36:28 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:36:28.175157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:28.185834 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413350f-bb91-4cb1-b45e-4ab7fca05e33 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:28.235016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:28.243329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:28.243877 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.244334 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.244814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.245720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:28.247709 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:28.268896 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1383/2790] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:36:28 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:36:28.273028 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:28.283391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a1450-a34c-4e44-975a-33b8e212d5b0 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:28.288003 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:28.288590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.288870 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.289143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.289780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:28.291417 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:28.302495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1408/2791] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:36:28.306516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:28.317427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582f51d-5d8b-4d6d-ae7e-8c271f0d8fbc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:28.321977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600bfff-7c02-4b9e-9582-bc4cb251aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:28.322696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600bfff-7c02-4b9e-9582-bc4cb251aa65 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.322983 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600bfff-7c02-4b9e-9582-bc4cb251aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.323259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600bfff-7c02-4b9e-9582-bc4cb251aa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.323898 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600bfff-7c02-4b9e-9582-bc4cb251aa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:28.325516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600bfff-7c02-4b9e-9582-bc4cb251aa65 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:28.338748 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1384/2792] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:36:28.343312 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:28.353371 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392392fc-c4bb-448c-82d3-b2baeac85c48 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:28.358210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:28.358852 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.359743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.360252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] PATH_INFO: `/v3/projects/8147c409b4324b4b94b60f4e2e0d793f/users/f42120a67c1c49a1bcefa55dd09293fe/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.374708 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8147c409b4324b4b94b60f4e2e0d793f, user_id=f42120a67c1c49a1bcefa55dd09293fe, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:28.378040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:28.391054 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1409/2793] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:36:28 2022] PUT /identity/v3/projects/8147c409b4324b4b94b60f4e2e0d793f/users/f42120a67c1c49a1bcefa55dd09293fe/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:36:28.462240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc95f-7772-4440-92a2-a3c794a72d75 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.462787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc95f-7772-4440-92a2-a3c794a72d75 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.462787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc95f-7772-4440-92a2-a3c794a72d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.492068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-788fc95f-7772-4440-92a2-a3c794a72d75 None None] MFA Rules not processed for user `f42120a67c1c49a1bcefa55dd09293fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:28.493280 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-788fc95f-7772-4440-92a2-a3c794a72d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:28.563734 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1385/2794] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:28.574325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:28.575973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:28.634529 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711375b5-d3df-42c7-8d9f-2f680a668631 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:28.638156 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63a7f-e5c0-44fe-9bd6-d99ad1af6153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:28.638749 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63a7f-e5c0-44fe-9bd6-d99ad1af6153 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:28.639023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63a7f-e5c0-44fe-9bd6-d99ad1af6153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:28.639291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63a7f-e5c0-44fe-9bd6-d99ad1af6153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:28.647846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe63a7f-e5c0-44fe-9bd6-d99ad1af6153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:28.649265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe63a7f-e5c0-44fe-9bd6-d99ad1af6153 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:28.652728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:28.660495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1410/2795] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:36:38.560361 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:38.663136 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:39.084197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3871224-7787-4983-be4e-9cdc8c7d8364 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:39.084473 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3871224-7787-4983-be4e-9cdc8c7d8364 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:39.084749 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3871224-7787-4983-be4e-9cdc8c7d8364 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:39.086270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1386/2796] 10.222.0.18 () {54 vars in 961 bytes} [Fri Sep 30 19:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 30 19:36:39.091639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7af0-6b62-48e7-a6fd-bd59b9e819bd None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:39.091925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7af0-6b62-48e7-a6fd-bd59b9e819bd None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:39.092197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7af0-6b62-48e7-a6fd-bd59b9e819bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:39.104801 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3871224-7787-4983-be4e-9cdc8c7d8364 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:39.157044 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-66cb7af0-6b62-48e7-a6fd-bd59b9e819bd None None] MFA Rules not processed for user `632070e9f5534d54852df7f6f0d50461`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:39.158297 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-66cb7af0-6b62-48e7-a6fd-bd59b9e819bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:39.173406 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3871224-7787-4983-be4e-9cdc8c7d8364 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:39.179059 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:39.179956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:39.179956 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:39.180199 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] PATH_INFO: `/v3/users/f42120a67c1c49a1bcefa55dd09293fe` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:39.181469 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f42120a67c1c49a1bcefa55dd09293fe)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:39.183225 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:39.230394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f42120a67c1c49a1bcefa55dd09293fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.231062 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f42120a67c1c49a1bcefa55dd09293fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.231939 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f42120a67c1c49a1bcefa55dd09293fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.234965 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1411/2797] 10.222.0.18 () {58 vars in 1058 bytes} [Fri Sep 30 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:36:39.239757 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f42120a67c1c49a1bcefa55dd09293fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.243405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb7af0-6b62-48e7-a6fd-bd59b9e819bd None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:39.249666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-77a46590-59a3-4a8e-bf2b-7a5a6f8af6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f42120a67c1c49a1bcefa55dd09293fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.254338 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb7af0-6b62-48e7-a6fd-bd59b9e819bd None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:39.260451 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:39.260857 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:39.261226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:39.261476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:39.264851 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:39.274759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1387/2798] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:36:39 2022] DELETE /identity/v3/users/f42120a67c1c49a1bcefa55dd09293fe => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:36:39.279041 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:39.279325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:39.279818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:39.280817 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:39.282516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:39.294822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1412/2799] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 30 19:36:39.303546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:36:39.304764 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:39.368369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1388/2800] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:36:39.379166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:39.380661 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:39.438117 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa4f5-cda3-4cfc-a48d-1d0c82575e8d service placement] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:39.490378 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:39.490978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:39.491254 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:39.491522 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:39.500549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:39.501964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:39.507565 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:39.512788 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1413/2801] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:36:39.808769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:39.810272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:39.827816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c167e-830f-4801-9bd4-2c0ede4f61bf None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:39.833296 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:39.834109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:39.834393 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:39.834662 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] PATH_INFO: `/v3/projects/8147c409b4324b4b94b60f4e2e0d793f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:39.835926 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8147c409b4324b4b94b60f4e2e0d793f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:39.837771 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:39.854136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:39.888647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8147c409b4324b4b94b60f4e2e0d793f', 'request_id': 'req-40bc0719-c410-408d-8d4f-bd6bf31a8393'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.899163 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8147c409b4324b4b94b60f4e2e0d793f', 'request_id': 'req-40bc0719-c410-408d-8d4f-bd6bf31a8393'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.918289 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8147c409b4324b4b94b60f4e2e0d793f', 'request_id': 'req-40bc0719-c410-408d-8d4f-bd6bf31a8393'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.921069 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] The token cache is being invalidate because project 8147c409b4324b4b94b60f4e2e0d793f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:36:39.922371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.923223 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:39.924684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1389/2802] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:36:39 2022] DELETE /identity/v3/projects/8147c409b4324b4b94b60f4e2e0d793f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:36:49.916916 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=18,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:51.080785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:51.082250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:51.142437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:51.143943 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:51.161023 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48334f57-13db-4383-a79c-7e17d4824264 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:51.211166 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc0719-c410-408d-8d4f-bd6bf31a8393 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:51.215883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:51.216502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:51.216778 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:51.217065 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] PATH_INFO: `/v3/users/73d9d4215ca84114a2b246995aec3dd6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:51.218202 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d9d4215ca84114a2b246995aec3dd6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:51.220096 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:51.223712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:51.224341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:51.224625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:51.224891 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:51.227272 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:36:51.238524 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:51.240101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:51.252132 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1414/2803] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:36:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:36:51.275799 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d9d4215ca84114a2b246995aec3dd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.276441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d9d4215ca84114a2b246995aec3dd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.277088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d9d4215ca84114a2b246995aec3dd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.284762 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d9d4215ca84114a2b246995aec3dd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.293244 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d9d4215ca84114a2b246995aec3dd6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.311093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1390/2804] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:36:51 2022] DELETE /identity/v3/users/73d9d4215ca84114a2b246995aec3dd6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:36:51.487925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:36:51.499933 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c870c8-7716-45c6-9fa6-1983490eb00b service placement] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:36:51.559791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:36:51.560408 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:36:51.560680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:36:51.560945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] PATH_INFO: `/v3/projects/edd40c93fc13441f894b10a2fd384155` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:36:51.562020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd40c93fc13441f894b10a2fd384155)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:36:51.563932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:36:51.600189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:36:51.611110 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd40c93fc13441f894b10a2fd384155', 'request_id': 'req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.617173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd40c93fc13441f894b10a2fd384155', 'request_id': 'req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.624356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd40c93fc13441f894b10a2fd384155', 'request_id': 'req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.634711 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] The token cache is being invalidate because project edd40c93fc13441f894b10a2fd384155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:36:51.634993 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.635635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:36:51.637061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1415/2805] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:36:51 2022] DELETE /identity/v3/projects/edd40c93fc13441f894b10a2fd384155 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:01.307967 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:01.631622 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:31.275039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:31.276531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:31.290569 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193e418-9df4-419b-93f4-18809abe43f8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:31.347299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:31.347920 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:31.348375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:31.348795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] PATH_INFO: `/v3/users/7a28576fcbc34c0f9dda76e8b390928a` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:31.349915 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a28576fcbc34c0f9dda76e8b390928a)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:31.351831 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:31.414462 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a28576fcbc34c0f9dda76e8b390928a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.415321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a28576fcbc34c0f9dda76e8b390928a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.416039 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a28576fcbc34c0f9dda76e8b390928a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.423281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a28576fcbc34c0f9dda76e8b390928a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.431281 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6a68d20f-977f-4d1f-9e90-d960b676517f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a28576fcbc34c0f9dda76e8b390928a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.450118 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1391/2806] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:37:31 2022] DELETE /identity/v3/users/7a28576fcbc34c0f9dda76e8b390928a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:31.621894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:31.623396 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:31.637855 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f0765-9f3b-4fd3-ace2-35467e2fcf2f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:31.696006 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:31.696559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:31.696832 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:31.697098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] PATH_INFO: `/v3/projects/05880f6406324dc39d4dcff2e6904a55` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:31.698236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=05880f6406324dc39d4dcff2e6904a55)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:31.700124 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:31.745433 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05880f6406324dc39d4dcff2e6904a55', 'request_id': 'req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.751476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05880f6406324dc39d4dcff2e6904a55', 'request_id': 'req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.758792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05880f6406324dc39d4dcff2e6904a55', 'request_id': 'req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.769020 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] The token cache is being invalidate because project 05880f6406324dc39d4dcff2e6904a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:37:31.769300 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.769914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e8f2df5e-1737-4116-a27f-4fd2f0502e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:31.771978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1416/2807] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:37:31 2022] DELETE /identity/v3/projects/05880f6406324dc39d4dcff2e6904a55 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:31.777063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030f33-4a7f-48d4-bd52-70d9ca3b6bf8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:31.777352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030f33-4a7f-48d4-bd52-70d9ca3b6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:31.777630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030f33-4a7f-48d4-bd52-70d9ca3b6bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:31.797513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-06030f33-4a7f-48d4-bd52-70d9ca3b6bf8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:31.798730 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-06030f33-4a7f-48d4-bd52-70d9ca3b6bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:31.858438 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1392/2808] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:31.866281 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe903-1d52-4c40-8137-21703cdc5dd7 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:31.866569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe903-1d52-4c40-8137-21703cdc5dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:31.866843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fe903-1d52-4c40-8137-21703cdc5dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:31.889987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-c41fe903-1d52-4c40-8137-21703cdc5dd7 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:31.891203 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-c41fe903-1d52-4c40-8137-21703cdc5dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:31.899844 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1417/2809] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:31.904038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030f33-4a7f-48d4-bd52-70d9ca3b6bf8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:31.913796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030f33-4a7f-48d4-bd52-70d9ca3b6bf8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:31.918357 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:31.918949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:31.919228 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:31.919498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:31.920137 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:37:31.920439 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:31.922036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:31.933519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1393/2810] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:37:31.937652 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fe903-1d52-4c40-8137-21703cdc5dd7 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:31.947360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fe903-1d52-4c40-8137-21703cdc5dd7 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:31.951828 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:31.952407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:31.952679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:31.952945 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:31.953563 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:31.955744 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:31.982815 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1418/2811] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:37:31 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:37:31.986924 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:31.997131 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54492db-a732-468b-a044-48fa553d7f18 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.000809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:32.057176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.057781 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.058079 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.058352 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.058986 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.060890 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.082785 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1394/2812] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:37:31 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:37:32.087704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.097676 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19278e36-65ae-45c9-95d4-14523a29e257 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.102843 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.103440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.103724 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.103998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.104705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.106391 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.116525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1419/2813] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:32.120444 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.131205 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943d5e3-eb48-47b7-a97a-8fc401065e38 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.136010 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460ae0a-8b83-46cd-b208-98a05701d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.136655 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ae0a-8b83-46cd-b208-98a05701d38a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.136938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ae0a-8b83-46cd-b208-98a05701d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.137212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460ae0a-8b83-46cd-b208-98a05701d38a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.137847 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460ae0a-8b83-46cd-b208-98a05701d38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.139458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460ae0a-8b83-46cd-b208-98a05701d38a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.150519 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1395/2814] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:32.154577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.164654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb417b0-fa7d-4b38-bae9-ad211cd74b3f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.169265 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.169932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.170241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.170513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] PATH_INFO: `/v3/projects/8fecd9079572443999f5183011e91a03/users/408292049f484b13a4c2424c599e7b04/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.184932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fecd9079572443999f5183011e91a03, user_id=408292049f484b13a4c2424c599e7b04, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.187780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.201206 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1420/2815] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:32 2022] PUT /identity/v3/projects/8fecd9079572443999f5183011e91a03/users/408292049f484b13a4c2424c599e7b04/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:32.212150 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d5ffd-79c7-4ea7-8264-149b126a2e96 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.212440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d5ffd-79c7-4ea7-8264-149b126a2e96 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.212721 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d5ffd-79c7-4ea7-8264-149b126a2e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.240750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-800d5ffd-79c7-4ea7-8264-149b126a2e96 None None] MFA Rules not processed for user `408292049f484b13a4c2424c599e7b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:32.241955 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-800d5ffd-79c7-4ea7-8264-149b126a2e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:32.306630 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1396/2816] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:32.311174 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.341609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:32.375662 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaead78-db99-4684-97a2-9a8655d98133 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.381064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.381651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.381929 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.382231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.382858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.384741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.410319 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1421/2817] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:37:32 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:32.414613 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d5ffd-79c7-4ea7-8264-149b126a2e96 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.425364 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d5ffd-79c7-4ea7-8264-149b126a2e96 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.481600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.482146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.482429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.482720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.483354 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.485258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.507237 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1397/2818] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:37:32 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:32.511303 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.521810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4780ef-fd00-4031-846d-1b52076b33b6 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.526447 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.527031 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.527307 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.527585 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.528197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.529780 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.540030 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1422/2819] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:32.544100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.550465 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:32.555102 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a8a14-d19d-4ae6-8c03-8a31b879dbd4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.560849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.561492 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.561766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.562035 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] PATH_INFO: `/v3/projects/219f2b3282c04f1b97e91d4d0cd86de2/users/a7fc490cb0d1405790fc489f4ced0585/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.577004 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219f2b3282c04f1b97e91d4d0cd86de2, user_id=a7fc490cb0d1405790fc489f4ced0585, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.579666 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.592252 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1398/2820] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:32 2022] PUT /identity/v3/projects/219f2b3282c04f1b97e91d4d0cd86de2/users/a7fc490cb0d1405790fc489f4ced0585/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:32.596112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.606556 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70df7-c7b4-48dc-8f3b-3f3c6ebbee1c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.663423 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addf28e-5730-4925-ac08-7b0362b0473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.664094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addf28e-5730-4925-ac08-7b0362b0473c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.664298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addf28e-5730-4925-ac08-7b0362b0473c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.664574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addf28e-5730-4925-ac08-7b0362b0473c admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.665216 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addf28e-5730-4925-ac08-7b0362b0473c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.666963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addf28e-5730-4925-ac08-7b0362b0473c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.677725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1423/2821] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:32.682000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.692215 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f08ccb-32ff-4c8d-9c06-f8b8d9660457 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.696912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.697562 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.697841 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.698146 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] PATH_INFO: `/v3/projects/219f2b3282c04f1b97e91d4d0cd86de2/users/a7fc490cb0d1405790fc489f4ced0585/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.700034 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] RBAC: Authorizing `identity:create_grant(project_id=219f2b3282c04f1b97e91d4d0cd86de2, user_id=a7fc490cb0d1405790fc489f4ced0585, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.702684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.713750 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1399/2822] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:32 2022] PUT /identity/v3/projects/219f2b3282c04f1b97e91d4d0cd86de2/users/a7fc490cb0d1405790fc489f4ced0585/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:32.725618 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf0a4c-7c72-426e-9fb4-f2c9a5bddd07 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.725901 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf0a4c-7c72-426e-9fb4-f2c9a5bddd07 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.726224 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf0a4c-7c72-426e-9fb4-f2c9a5bddd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.754533 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-8bbf0a4c-7c72-426e-9fb4-f2c9a5bddd07 None None] MFA Rules not processed for user `a7fc490cb0d1405790fc489f4ced0585`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:32.755709 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-8bbf0a4c-7c72-426e-9fb4-f2c9a5bddd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:32.822516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1424/2823] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:32.835617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:32.837472 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:32.915985 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6c2cc-55bf-415e-b31e-af17b022746f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:32.919612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:32.920213 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:32.920488 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:32.920756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:32.930000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:32.931447 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:32.940752 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1400/2824] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:37:33.018779 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf0a4c-7c72-426e-9fb4-f2c9a5bddd07 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:33.028516 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf0a4c-7c72-426e-9fb4-f2c9a5bddd07 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:33.032147 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceb6f1-49d0-4510-b292-e6bf12fc5b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:33.032738 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceb6f1-49d0-4510-b292-e6bf12fc5b80 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:33.033016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceb6f1-49d0-4510-b292-e6bf12fc5b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:33.033289 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceb6f1-49d0-4510-b292-e6bf12fc5b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:33.053091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:33.092217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceb6f1-49d0-4510-b292-e6bf12fc5b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:33.093687 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ceb6f1-49d0-4510-b292-e6bf12fc5b80 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:33.103005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1425/2825] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:37:39.897537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:39.960315 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2f2e8-3e51-44fb-8e25-3dffe2287442 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:39.965572 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:39.966250 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:39.966525 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:39.966792 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] PATH_INFO: `/v3/users/408292049f484b13a4c2424c599e7b04` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:39.967903 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408292049f484b13a4c2424c599e7b04)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:39.969803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:40.018685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408292049f484b13a4c2424c599e7b04'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.019270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408292049f484b13a4c2424c599e7b04'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.019879 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408292049f484b13a4c2424c599e7b04'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.025197 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:40.029335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408292049f484b13a4c2424c599e7b04'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.040875 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408292049f484b13a4c2424c599e7b04'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.065404 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1401/2826] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:37:39 2022] DELETE /identity/v3/users/408292049f484b13a4c2424c599e7b04 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:40.070729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:40.070729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:40.070729 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:40.090980 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:40.092182 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:40.151881 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1426/2827] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:40.162295 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:40.163808 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:40.246573 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8982d1e-8a9c-47ee-a2d3-4985e9d1f044 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:40.250221 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:40.250820 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:40.251101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:40.251374 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:40.260689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:40.262134 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:40.271612 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1402/2828] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:37:40.547602 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:40.549202 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:40.563313 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0411cb-d486-4648-90b7-16a29b4be8e4 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:40.567936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:40.568580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:40.568853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:40.569651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] PATH_INFO: `/v3/projects/8fecd9079572443999f5183011e91a03` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:40.571713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fecd9079572443999f5183011e91a03)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:40.574082 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:40.620617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fecd9079572443999f5183011e91a03', 'request_id': 'req-cdb41e5d-207e-4e70-a0ed-20edb3e63770'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.627617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fecd9079572443999f5183011e91a03', 'request_id': 'req-cdb41e5d-207e-4e70-a0ed-20edb3e63770'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.635022 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fecd9079572443999f5183011e91a03', 'request_id': 'req-cdb41e5d-207e-4e70-a0ed-20edb3e63770'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.646094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] The token cache is being invalidate because project 8fecd9079572443999f5183011e91a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:37:40.646374 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.646982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.649081 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1427/2829] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:37:40 2022] DELETE /identity/v3/projects/8fecd9079572443999f5183011e91a03 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:40.653008 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:40.662365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5a50-3028-41db-af57-56d7be29baab service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:40.718809 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:40.719425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:40.719705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:40.719975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] PATH_INFO: `/v3/users/a7fc490cb0d1405790fc489f4ced0585` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:40.721082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fc490cb0d1405790fc489f4ced0585)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:40.723024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:40.772151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fc490cb0d1405790fc489f4ced0585'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.772793 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fc490cb0d1405790fc489f4ced0585'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.773905 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fc490cb0d1405790fc489f4ced0585'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.779082 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:40.781323 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fc490cb0d1405790fc489f4ced0585'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.789988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2305925e-e2cc-447b-aa30-40a1f2cb2259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fc490cb0d1405790fc489f4ced0585'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:40.808369 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1403/2830] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:37:40 2022] DELETE /identity/v3/users/a7fc490cb0d1405790fc489f4ced0585 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:41.087034 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.088635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:41.101909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb41e5d-207e-4e70-a0ed-20edb3e63770 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.146098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:41.163462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.164168 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.164446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.164722 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] PATH_INFO: `/v3/projects/219f2b3282c04f1b97e91d4d0cd86de2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.165836 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219f2b3282c04f1b97e91d4d0cd86de2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.167791 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.214372 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219f2b3282c04f1b97e91d4d0cd86de2', 'request_id': 'req-ad10e1a6-4803-4bec-95c4-909d18fd05a6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:41.220366 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219f2b3282c04f1b97e91d4d0cd86de2', 'request_id': 'req-ad10e1a6-4803-4bec-95c4-909d18fd05a6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:41.227353 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219f2b3282c04f1b97e91d4d0cd86de2', 'request_id': 'req-ad10e1a6-4803-4bec-95c4-909d18fd05a6'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:41.237928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] The token cache is being invalidate because project 219f2b3282c04f1b97e91d4d0cd86de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:37:41.238250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:41.238897 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ad10e1a6-4803-4bec-95c4-909d18fd05a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:41.240428 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1428/2831] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:37:41 2022] DELETE /identity/v3/projects/219f2b3282c04f1b97e91d4d0cd86de2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:41.245960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4399-7569-4a4a-ab89-2d81791bcedd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.246511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4399-7569-4a4a-ab89-2d81791bcedd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.246640 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d4399-7569-4a4a-ab89-2d81791bcedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.268148 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dd1d4399-7569-4a4a-ab89-2d81791bcedd None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:41.269347 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dd1d4399-7569-4a4a-ab89-2d81791bcedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:41.329452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1404/2832] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:41.337644 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ac3a6-3284-4785-8d8a-f11216c2caa6 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.337934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ac3a6-3284-4785-8d8a-f11216c2caa6 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.338242 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ac3a6-3284-4785-8d8a-f11216c2caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.357885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-ae0ac3a6-3284-4785-8d8a-f11216c2caa6 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:41.358990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ae0ac3a6-3284-4785-8d8a-f11216c2caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:41.367572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1429/2833] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:41.371828 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4399-7569-4a4a-ab89-2d81791bcedd None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.381484 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d4399-7569-4a4a-ab89-2d81791bcedd None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.387175 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.387791 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.388106 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.388382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.389027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:37:41.389333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.390954 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.405726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1405/2834] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:37:41.408498 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ac3a6-3284-4785-8d8a-f11216c2caa6 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.419379 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ac3a6-3284-4785-8d8a-f11216c2caa6 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.424060 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.424654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.424932 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.425209 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.425961 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.428038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.456446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1430/2835] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:37:41 2022] POST /identity/v3/projects => generated 353 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:41.460872 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.471130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e0a4d-ab8a-446f-9785-bcea814b7f21 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.528647 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.529231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.529511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.529780 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.530461 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.532412 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.552940 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1406/2836] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:37:41 2022] POST /identity/v3/users => generated 277 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:41.557547 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.567609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251dbb5-4007-493f-ada1-dc5712074acc admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.573407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.574004 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.574315 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.574697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.575342 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.576952 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.587406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1431/2837] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:41.591006 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.600937 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980e4b8-e1a6-4800-abf0-4343e77a59e9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.606151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49f81f-be9d-45ca-801d-bf60d122de0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.606735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49f81f-be9d-45ca-801d-bf60d122de0b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.607012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49f81f-be9d-45ca-801d-bf60d122de0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.607283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49f81f-be9d-45ca-801d-bf60d122de0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.607913 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49f81f-be9d-45ca-801d-bf60d122de0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.609478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49f81f-be9d-45ca-801d-bf60d122de0b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.620500 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1407/2838] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:41.624345 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.634077 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ac87-bf3e-4b7c-923e-37a76b202fbd admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.638666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.639309 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.639590 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.639914 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] PATH_INFO: `/v3/projects/e2b074d7da7a4ee2ae8e856481a204c2/users/cb3f44796afb4929a3c25d14b35798de/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.654474 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b074d7da7a4ee2ae8e856481a204c2, user_id=cb3f44796afb4929a3c25d14b35798de, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.657104 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.670930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1432/2839] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:41 2022] PUT /identity/v3/projects/e2b074d7da7a4ee2ae8e856481a204c2/users/cb3f44796afb4929a3c25d14b35798de/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:37:41.682849 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a0af-ed6b-4b91-a59d-0c07392b1e31 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.683136 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a0af-ed6b-4b91-a59d-0c07392b1e31 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.683414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2a0af-ed6b-4b91-a59d-0c07392b1e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.710711 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-39c2a0af-ed6b-4b91-a59d-0c07392b1e31 None None] MFA Rules not processed for user `cb3f44796afb4929a3c25d14b35798de`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:41.712301 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-39c2a0af-ed6b-4b91-a59d-0c07392b1e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:41.738426 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:41.783083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1408/2840] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:41.787651 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.851111 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96af26-5dd0-42c1-811d-e3680c079954 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.856217 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.856814 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.857092 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.857363 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.857998 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.859918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.875093 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:41.888580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1433/2841] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:37:41 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:41.892694 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a0af-ed6b-4b91-a59d-0c07392b1e31 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.903999 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2a0af-ed6b-4b91-a59d-0c07392b1e31 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:41.959543 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:41.960140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:41.960415 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:41.960682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:41.961621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:41.963541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:41.984014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1409/2842] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:37:41 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:41.988084 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:41.998936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfb0ee-fdb9-4566-9655-8c3f882e25af admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:42.003606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:42.004205 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:42.004519 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:42.004797 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:42.005438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:42.007116 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:42.018252 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1434/2843] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:42.022191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:42.032416 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c1ed2-4c84-4b4d-9bb6-e07142943308 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:42.037058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:42.037700 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:42.037984 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:42.038297 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] PATH_INFO: `/v3/projects/05a25a5058b04234a1a2a4138fbaf9a7/users/18cb67bb0f2f4b39a593f50c90f454c5/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:42.052911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a25a5058b04234a1a2a4138fbaf9a7, user_id=18cb67bb0f2f4b39a593f50c90f454c5, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:42.056241 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:42.069632 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1410/2844] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:42 2022] PUT /identity/v3/projects/05a25a5058b04234a1a2a4138fbaf9a7/users/18cb67bb0f2f4b39a593f50c90f454c5/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:42.074266 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:42.084367 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8291f8-8097-4aa9-a7ce-34c94587d948 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:42.143438 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7d66-b86a-443d-985c-a6e0fa77c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:42.144107 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7d66-b86a-443d-985c-a6e0fa77c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:42.144236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7d66-b86a-443d-985c-a6e0fa77c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:42.144478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7d66-b86a-443d-985c-a6e0fa77c9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:42.145114 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7d66-b86a-443d-985c-a6e0fa77c9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:42.146737 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7d66-b86a-443d-985c-a6e0fa77c9b4 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:42.156883 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1435/2845] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:42.161024 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:42.171283 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c9b5-5fcf-4c8d-8798-520dbba6256b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:42.175812 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:42.176443 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:42.176719 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:42.176988 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] PATH_INFO: `/v3/projects/05a25a5058b04234a1a2a4138fbaf9a7/users/18cb67bb0f2f4b39a593f50c90f454c5/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:42.178887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a25a5058b04234a1a2a4138fbaf9a7, user_id=18cb67bb0f2f4b39a593f50c90f454c5, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:42.181965 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:42.191783 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1411/2846] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:42 2022] PUT /identity/v3/projects/05a25a5058b04234a1a2a4138fbaf9a7/users/18cb67bb0f2f4b39a593f50c90f454c5/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:42.203033 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a271ba-4dd9-462e-bf0e-7b9070fb6a07 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:42.203321 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a271ba-4dd9-462e-bf0e-7b9070fb6a07 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:42.203591 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a271ba-4dd9-462e-bf0e-7b9070fb6a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:42.231716 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a7a271ba-4dd9-462e-bf0e-7b9070fb6a07 None None] MFA Rules not processed for user `18cb67bb0f2f4b39a593f50c90f454c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:42.232927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a7a271ba-4dd9-462e-bf0e-7b9070fb6a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:42.300347 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1436/2847] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:42.312571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:42.314383 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:42.375590 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b38fd-fb0e-4650-bd88-1044bd03055d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:42.379231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:42.379829 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:42.380109 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:42.380382 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:42.389274 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:42.390725 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:42.400259 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1412/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:37:42.475489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a271ba-4dd9-462e-bf0e-7b9070fb6a07 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:42.485972 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a271ba-4dd9-462e-bf0e-7b9070fb6a07 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:42.489575 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715305-dfbe-4ae3-95f5-8ebb5d5f693e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:42.490190 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715305-dfbe-4ae3-95f5-8ebb5d5f693e service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:42.490468 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715305-dfbe-4ae3-95f5-8ebb5d5f693e service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:42.490735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715305-dfbe-4ae3-95f5-8ebb5d5f693e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:42.546674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715305-dfbe-4ae3-95f5-8ebb5d5f693e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:42.548118 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b715305-dfbe-4ae3-95f5-8ebb5d5f693e service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:42.557370 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1437/2849] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:37:52.395977 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:52.552752 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=98 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:57.382312 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:57.444012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9937222-a11c-48d6-abfe-02aafd3ee5ca service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:57.448510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:57.449336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:57.449713 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:57.449990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] PATH_INFO: `/v3/users/cb3f44796afb4929a3c25d14b35798de` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:57.451128 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3f44796afb4929a3c25d14b35798de)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:57.453032 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:57.500179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3f44796afb4929a3c25d14b35798de'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:57.500817 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3f44796afb4929a3c25d14b35798de'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:57.501414 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3f44796afb4929a3c25d14b35798de'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:57.508220 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3f44796afb4929a3c25d14b35798de'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:57.515578 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3f44796afb4929a3c25d14b35798de'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:57.532240 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1413/2850] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:37:57 2022] DELETE /identity/v3/users/cb3f44796afb4929a3c25d14b35798de => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:57.536756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:57.537235 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:57.537343 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:57.557074 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:57.559008 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:57.615607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1438/2851] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:57.626938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:57.628325 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:57.684803 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974fd48-78a5-4ab0-a2f6-afc3b477e56e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:57.688441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:57.689036 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:57.689321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:57.689596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:57.698456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:57.700055 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:57.709308 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1414/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:37:57.981940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:57.983462 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:57.996598 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2ff6-34cf-4f75-b6c5-1e170d5b946a None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:58.001356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:58.002005 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.002311 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.002611 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] PATH_INFO: `/v3/projects/e2b074d7da7a4ee2ae8e856481a204c2` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.003728 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b074d7da7a4ee2ae8e856481a204c2)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:58.005629 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:58.053515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b074d7da7a4ee2ae8e856481a204c2', 'request_id': 'req-1267777d-1af3-4d39-8c77-54880d2709d9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.060178 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b074d7da7a4ee2ae8e856481a204c2', 'request_id': 'req-1267777d-1af3-4d39-8c77-54880d2709d9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.068220 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b074d7da7a4ee2ae8e856481a204c2', 'request_id': 'req-1267777d-1af3-4d39-8c77-54880d2709d9'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.079478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] The token cache is being invalidate because project e2b074d7da7a4ee2ae8e856481a204c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:37:58.079768 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.080390 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.081959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1439/2853] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:37:57 2022] DELETE /identity/v3/projects/e2b074d7da7a4ee2ae8e856481a204c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:58.085846 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:58.096101 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583c613-2bc3-437d-bbfc-46a5e0e0dafc service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:58.113737 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:58.153299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:58.153925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.154238 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.154513 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] PATH_INFO: `/v3/users/18cb67bb0f2f4b39a593f50c90f454c5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.155659 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cb67bb0f2f4b39a593f50c90f454c5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:58.157621 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:58.202618 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cb67bb0f2f4b39a593f50c90f454c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.203258 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cb67bb0f2f4b39a593f50c90f454c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.203869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cb67bb0f2f4b39a593f50c90f454c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.210753 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cb67bb0f2f4b39a593f50c90f454c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.218774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c003a38a-9b28-4469-9c23-5f4e677a01ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cb67bb0f2f4b39a593f50c90f454c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.237498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1415/2854] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:37:58 2022] DELETE /identity/v3/users/18cb67bb0f2f4b39a593f50c90f454c5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:58.506638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:58.508113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:58.521808 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267777d-1af3-4d39-8c77-54880d2709d9 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:58.578970 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:58.579665 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.579858 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.580126 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] PATH_INFO: `/v3/projects/05a25a5058b04234a1a2a4138fbaf9a7` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.581215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a25a5058b04234a1a2a4138fbaf9a7)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:58.583143 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:58.615475 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:58.633113 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a25a5058b04234a1a2a4138fbaf9a7', 'request_id': 'req-99b45f74-ab02-4831-80de-36b5dd0dd6a7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.639406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a25a5058b04234a1a2a4138fbaf9a7', 'request_id': 'req-99b45f74-ab02-4831-80de-36b5dd0dd6a7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.645907 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a25a5058b04234a1a2a4138fbaf9a7', 'request_id': 'req-99b45f74-ab02-4831-80de-36b5dd0dd6a7'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.657768 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] The token cache is being invalidate because project 05a25a5058b04234a1a2a4138fbaf9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:37:58.658080 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.658816 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-99b45f74-ab02-4831-80de-36b5dd0dd6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:37:58.660301 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1440/2855] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:37:58 2022] DELETE /identity/v3/projects/05a25a5058b04234a1a2a4138fbaf9a7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:58.665142 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690fbb7-c12a-42ce-ac41-e9ebdc34eaf2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.665614 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690fbb7-c12a-42ce-ac41-e9ebdc34eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.665770 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690fbb7-c12a-42ce-ac41-e9ebdc34eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.689319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c690fbb7-c12a-42ce-ac41-e9ebdc34eaf2 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:58.690451 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c690fbb7-c12a-42ce-ac41-e9ebdc34eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:58.748203 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1416/2856] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:58.756189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f58b2-3492-4186-8040-10a01b5d0af8 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.756472 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f58b2-3492-4186-8040-10a01b5d0af8 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.756742 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f58b2-3492-4186-8040-10a01b5d0af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.776002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-bd9f58b2-3492-4186-8040-10a01b5d0af8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:58.777185 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-bd9f58b2-3492-4186-8040-10a01b5d0af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:58.785607 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1441/2857] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:58.789856 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690fbb7-c12a-42ce-ac41-e9ebdc34eaf2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:58.800276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690fbb7-c12a-42ce-ac41-e9ebdc34eaf2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:58.804947 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:58.805536 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.805818 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.806130 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.806773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:37:58.807078 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:58.808732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:58.820061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1417/2858] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:37:58.824782 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f58b2-3492-4186-8040-10a01b5d0af8 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:58.833866 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f58b2-3492-4186-8040-10a01b5d0af8 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:58.838789 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:58.839381 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.839672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.839976 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.841237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:58.843161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:58.869489 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1442/2859] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:37:58 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:58.873914 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:58.883938 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc109ae-8c15-4a74-8ec6-c02c7744dc7f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:58.910619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:58.942339 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:58.942860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.943135 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.943425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.944031 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:58.945909 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:58.968043 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1418/2860] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:37:58 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 30 19:37:58.973490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:58.984597 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89820b4a-e602-47f8-a920-a4e6ad2af753 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:58.989204 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:58.989801 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:58.990097 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:58.990373 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:58.991016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:58.992605 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.002639 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1443/2861] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:59.006532 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.016741 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fd856-f35e-46e2-91f7-650cad29dce3 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.021319 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeb63f-4268-416b-863e-7003e9c4e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.021902 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb63f-4268-416b-863e-7003e9c4e7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.022209 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb63f-4268-416b-863e-7003e9c4e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.022478 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeb63f-4268-416b-863e-7003e9c4e7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.023112 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eeb63f-4268-416b-863e-7003e9c4e7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.024680 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eeb63f-4268-416b-863e-7003e9c4e7b3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.036685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1419/2862] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:59.040842 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.050942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc92a-dcde-49fc-9181-27b930e9b02f admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.055649 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.056325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.056700 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.056943 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] PATH_INFO: `/v3/projects/e2a2be08a046455ba740abd9f84eb557/users/e4f27abf0a7b44c0b6a9132298f77af9/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.073325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a2be08a046455ba740abd9f84eb557, user_id=e4f27abf0a7b44c0b6a9132298f77af9, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.077856 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.093508 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1444/2863] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:59 2022] PUT /identity/v3/projects/e2a2be08a046455ba740abd9f84eb557/users/e4f27abf0a7b44c0b6a9132298f77af9/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:59.157563 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875730c4-bd2b-48cd-8c92-ce25e13ed3cd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.157869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875730c4-bd2b-48cd-8c92-ce25e13ed3cd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.158157 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875730c4-bd2b-48cd-8c92-ce25e13ed3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.185895 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-875730c4-bd2b-48cd-8c92-ce25e13ed3cd None None] MFA Rules not processed for user `e4f27abf0a7b44c0b6a9132298f77af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:59.187140 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-875730c4-bd2b-48cd-8c92-ce25e13ed3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:59.249904 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1420/2864] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:59.254285 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.315420 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7509c-7ff7-4615-8163-548550dfa5b7 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.320047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.320638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.320918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.321183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.321799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.323717 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.352394 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1445/2865] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:37:59 2022] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:59.356495 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875730c4-bd2b-48cd-8c92-ce25e13ed3cd None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.372619 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875730c4-bd2b-48cd-8c92-ce25e13ed3cd None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.430071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.430685 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.430960 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.431230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.431854 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.434366 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.455957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1421/2866] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:37:59 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:37:59.459973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.471105 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530d842-25f7-47b6-a7d6-a4c736a74d39 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.475682 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.476270 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.476543 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.476810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.477440 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.479048 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.489633 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1446/2867] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:59.493600 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.504300 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348a821-9c3c-4169-a91d-db5558165b39 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.508735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.509376 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.509653 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.509922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] PATH_INFO: `/v3/projects/fe6dc8f2614140a48f88b181a94fb22e/users/531afa605b214851ac552899091282dd/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.524759 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6dc8f2614140a48f88b181a94fb22e, user_id=531afa605b214851ac552899091282dd, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.527475 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.540210 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1422/2868] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:59 2022] PUT /identity/v3/projects/fe6dc8f2614140a48f88b181a94fb22e/users/531afa605b214851ac552899091282dd/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:37:59.544277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.554515 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b758da-5ecc-4e2b-a202-4c860d645da3 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.574101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:59.612236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37986749-34e4-47b1-af2e-dffba07fd9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.612903 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37986749-34e4-47b1-af2e-dffba07fd9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.613089 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37986749-34e4-47b1-af2e-dffba07fd9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.613356 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37986749-34e4-47b1-af2e-dffba07fd9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.613982 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37986749-34e4-47b1-af2e-dffba07fd9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.615580 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37986749-34e4-47b1-af2e-dffba07fd9c2 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.625364 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1447/2869] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:37:59.629471 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.634936 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:37:59.641012 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33868f1-da11-4eb8-bbbd-7aaef2f89310 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.646061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.646720 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.647002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.647270 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] PATH_INFO: `/v3/projects/fe6dc8f2614140a48f88b181a94fb22e/users/531afa605b214851ac552899091282dd/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.649170 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6dc8f2614140a48f88b181a94fb22e, user_id=531afa605b214851ac552899091282dd, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.651845 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.661805 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1423/2870] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:37:59 2022] PUT /identity/v3/projects/fe6dc8f2614140a48f88b181a94fb22e/users/531afa605b214851ac552899091282dd/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:37:59.672135 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5facc-34ec-4d06-a04a-e409766ff496 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.672416 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5facc-34ec-4d06-a04a-e409766ff496 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.672686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5facc-34ec-4d06-a04a-e409766ff496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.700846 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-63e5facc-34ec-4d06-a04a-e409766ff496 None None] MFA Rules not processed for user `531afa605b214851ac552899091282dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:37:59.702596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-63e5facc-34ec-4d06-a04a-e409766ff496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:59.772298 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1448/2871] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:37:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:37:59.783975 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.785774 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:37:59.844091 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63071a4-314a-4ca8-8628-70d452f63aec admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.847842 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.848440 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.848717 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.848990 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:37:59.858531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:37:59.859949 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:37:59.869460 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1424/2872] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:37:59.947792 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5facc-34ec-4d06-a04a-e409766ff496 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:37:59.957734 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5facc-34ec-4d06-a04a-e409766ff496 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:37:59.961572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267081-c841-4d4d-9867-3f106b87e909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:37:59.962464 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267081-c841-4d4d-9867-3f106b87e909 service cinder] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:37:59.962746 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267081-c841-4d4d-9867-3f106b87e909 service cinder] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:37:59.963025 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267081-c841-4d4d-9867-3f106b87e909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:00.019304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267081-c841-4d4d-9867-3f106b87e909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:00.020735 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267081-c841-4d4d-9867-3f106b87e909 service cinder] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:00.030215 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1449/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:06.139009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:06.200726 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3a1ab-69ad-4126-8b8c-bfd81bfd87c9 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:06.205736 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:06.206390 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:06.206696 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:06.206991 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] PATH_INFO: `/v3/users/e4f27abf0a7b44c0b6a9132298f77af9` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:06.208141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f27abf0a7b44c0b6a9132298f77af9)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:06.210028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:06.257276 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f27abf0a7b44c0b6a9132298f77af9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.257918 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f27abf0a7b44c0b6a9132298f77af9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.258541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f27abf0a7b44c0b6a9132298f77af9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.266537 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f27abf0a7b44c0b6a9132298f77af9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.273922 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f27abf0a7b44c0b6a9132298f77af9'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.291502 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1425/2874] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:38:06 2022] DELETE /identity/v3/users/e4f27abf0a7b44c0b6a9132298f77af9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:06.296635 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:06.297103 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:06.297227 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:06.315679 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:06.316849 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:06.356237 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=100 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:06.376314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1450/2875] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:06.386003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:06.387408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:06.401265 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:06.445380 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1cff6-162e-4308-aa83-05af2370eb84 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:06.449016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:06.449611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:06.449887 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:06.450186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:06.459664 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:06.461074 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:06.471003 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1426/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:06.735291 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:06.736741 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:06.749069 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884a0fe-28ee-4f82-978f-eb497d8da9aa None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:06.754288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:06.754930 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:06.755210 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:06.755485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] PATH_INFO: `/v3/projects/e2a2be08a046455ba740abd9f84eb557` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:06.756636 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a2be08a046455ba740abd9f84eb557)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:06.758572 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:06.810962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a2be08a046455ba740abd9f84eb557', 'request_id': 'req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.817035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a2be08a046455ba740abd9f84eb557', 'request_id': 'req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.824422 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a2be08a046455ba740abd9f84eb557', 'request_id': 'req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.835061 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] The token cache is being invalidate because project e2a2be08a046455ba740abd9f84eb557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:38:06.835350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.835973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.837443 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1451/2877] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:38:06 2022] DELETE /identity/v3/projects/e2a2be08a046455ba740abd9f84eb557 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:06.842595 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:06.852375 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6473592-a782-4876-ae84-2df1ea441799 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:06.907186 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:06.907802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:06.908077 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:06.908396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] PATH_INFO: `/v3/users/531afa605b214851ac552899091282dd` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:06.909435 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531afa605b214851ac552899091282dd)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:06.911396 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:06.958633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531afa605b214851ac552899091282dd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.959264 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531afa605b214851ac552899091282dd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.959858 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531afa605b214851ac552899091282dd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.967093 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531afa605b214851ac552899091282dd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.975309 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f99cdc9c-c221-4a4f-b4b0-ad65df624847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531afa605b214851ac552899091282dd'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:06.992159 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1427/2878] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:38:06 2022] DELETE /identity/v3/users/531afa605b214851ac552899091282dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:07.273123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:07.275154 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:07.289063 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa245fb-0d54-4cc0-9a93-723d3c15bc62 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:07.349478 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:07.350161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.350398 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.350666 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] PATH_INFO: `/v3/projects/fe6dc8f2614140a48f88b181a94fb22e` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.351758 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6dc8f2614140a48f88b181a94fb22e)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:07.354037 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:07.402491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6dc8f2614140a48f88b181a94fb22e', 'request_id': 'req-8eab1589-64c6-406c-8628-b04e9aac6c96'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:07.408525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6dc8f2614140a48f88b181a94fb22e', 'request_id': 'req-8eab1589-64c6-406c-8628-b04e9aac6c96'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:07.415928 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6dc8f2614140a48f88b181a94fb22e', 'request_id': 'req-8eab1589-64c6-406c-8628-b04e9aac6c96'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:07.424075 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:07.429045 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] The token cache is being invalidate because project fe6dc8f2614140a48f88b181a94fb22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81455) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:38:07.429341 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:07.430231 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-8eab1589-64c6-406c-8628-b04e9aac6c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:07.432038 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1452/2879] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:38:07 2022] DELETE /identity/v3/projects/fe6dc8f2614140a48f88b181a94fb22e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:07.437071 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969932c-21fb-494c-802d-e508621a5b8e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.437570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969932c-21fb-494c-802d-e508621a5b8e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.437676 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969932c-21fb-494c-802d-e508621a5b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.457313 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c969932c-21fb-494c-802d-e508621a5b8e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:07.458457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c969932c-21fb-494c-802d-e508621a5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:07.488683 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:07.520756 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1428/2880] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:07.530406 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60a68-5121-4c1d-a78c-f4ea8f44df14 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.530691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60a68-5121-4c1d-a78c-f4ea8f44df14 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.530962 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60a68-5121-4c1d-a78c-f4ea8f44df14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.550818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-28d60a68-5121-4c1d-a78c-f4ea8f44df14 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:07.552011 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-28d60a68-5121-4c1d-a78c-f4ea8f44df14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:07.559705 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1453/2881] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:07.563816 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969932c-21fb-494c-802d-e508621a5b8e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:07.573526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969932c-21fb-494c-802d-e508621a5b8e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:07.578160 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:07.578761 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.579018 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.579284 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.579921 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:38:07.580217 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:07.581787 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:07.593906 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1429/2882] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:38:07.598131 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60a68-5121-4c1d-a78c-f4ea8f44df14 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:07.608098 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60a68-5121-4c1d-a78c-f4ea8f44df14 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:07.617813 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:07.618860 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.619150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.619431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.620078 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:07.621990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:07.651840 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1454/2883] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:38:07 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:07.656952 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:07.667014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad41387-9682-4228-a172-6f8be315efba admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:07.721723 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:07.722269 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.722546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.722814 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.723437 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:07.725321 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:07.746327 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1430/2884] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:38:07 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:07.750697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:07.760978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ccffba-9780-4bfe-a5bb-4ef05cc8122b admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:07.765776 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:07.766405 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.766686 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.766959 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.767596 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:07.769183 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:07.778990 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1455/2885] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:07.783530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:07.793356 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854ddcd-cdcc-491f-85b5-22e6638d3ba5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:07.798633 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae29cc4-c0e3-4c12-b0b6-931055f3d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:07.799251 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29cc4-c0e3-4c12-b0b6-931055f3d052 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.799527 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29cc4-c0e3-4c12-b0b6-931055f3d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.799796 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae29cc4-c0e3-4c12-b0b6-931055f3d052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.800429 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae29cc4-c0e3-4c12-b0b6-931055f3d052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:07.802002 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae29cc4-c0e3-4c12-b0b6-931055f3d052 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:07.812663 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1431/2886] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:07.816755 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:07.827186 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51a6e-b12f-453b-bed9-66f6d7d96c3d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:07.831790 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:07.832431 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] REQUEST_METHOD: `PUT` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.832712 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.832987 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] PATH_INFO: `/v3/projects/9e33d29e38964e2687d5acf2a265c644/users/ecb798227893485880d516d53d750c43/roles/101229ee973c472f99780a668e4c403f` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.848632 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e33d29e38964e2687d5acf2a265c644, user_id=ecb798227893485880d516d53d750c43, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:07.851325 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:07.863672 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1456/2887] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:38:07 2022] PUT /identity/v3/projects/9e33d29e38964e2687d5acf2a265c644/users/ecb798227893485880d516d53d750c43/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:07.873919 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d87b-3798-4b7d-93b1-c4bc429e3074 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:07.874318 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d87b-3798-4b7d-93b1-c4bc429e3074 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:07.874593 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d87b-3798-4b7d-93b1-c4bc429e3074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:07.902141 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a0a7d87b-3798-4b7d-93b1-c4bc429e3074 None None] MFA Rules not processed for user `ecb798227893485880d516d53d750c43`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:07.903332 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a0a7d87b-3798-4b7d-93b1-c4bc429e3074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:07.977231 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1432/2888] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:07.981667 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:08.042166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88608c7-e941-4633-9575-c5f243c0397c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:08.046894 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:08.047486 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.047767 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.048040 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.048656 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:08.050592 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:08.077657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1457/2889] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:38:07 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:08.081790 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7d87b-3798-4b7d-93b1-c4bc429e3074 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:08.093343 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7d87b-3798-4b7d-93b1-c4bc429e3074 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:08.119075 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:08.149962 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:08.150585 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.150871 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.151145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.151763 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:08.153674 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:08.174070 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1433/2890] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:38:08 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:08.178331 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:08.189375 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae68be9-c3ba-43e1-9a42-c2ce4bc2f8c1 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:08.193958 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:08.194625 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.194900 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.195166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.195799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:08.197407 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:08.208491 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1458/2891] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:08.212511 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:08.222836 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128e94b-f27b-4efe-b60e-db99def6a94c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:08.227479 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:08.228063 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.228340 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.228611 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] PATH_INFO: `/v3/projects/ac8a60cdb8f5489e889fdfdef9a73efb/users/3b3917c541d243b79f6eb57cd222f551/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.243066 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8a60cdb8f5489e889fdfdef9a73efb, user_id=3b3917c541d243b79f6eb57cd222f551, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:08.245701 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:08.258844 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1434/2892] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:38:08 2022] PUT /identity/v3/projects/ac8a60cdb8f5489e889fdfdef9a73efb/users/3b3917c541d243b79f6eb57cd222f551/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:08.262973 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:08.273562 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c8c15-6035-443b-927d-47036f3dc707 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:08.329681 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85432d95-c578-4fcc-96a9-7b891c64b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:08.330317 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432d95-c578-4fcc-96a9-7b891c64b321 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.330594 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432d95-c578-4fcc-96a9-7b891c64b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.330863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85432d95-c578-4fcc-96a9-7b891c64b321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.331495 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85432d95-c578-4fcc-96a9-7b891c64b321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:08.333088 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85432d95-c578-4fcc-96a9-7b891c64b321 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:08.342916 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1459/2893] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:08.347072 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:08.360531 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6f281-44f9-4f3c-b274-310bc1570315 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:08.365189 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:08.365867 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.366182 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.366457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] PATH_INFO: `/v3/projects/ac8a60cdb8f5489e889fdfdef9a73efb/users/3b3917c541d243b79f6eb57cd222f551/roles/cb2d2c8aadb342ac970c4bb846301c1d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.368362 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac8a60cdb8f5489e889fdfdef9a73efb, user_id=3b3917c541d243b79f6eb57cd222f551, role_id=cb2d2c8aadb342ac970c4bb846301c1d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:08.371016 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:08.382626 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1435/2894] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:38:08 2022] PUT /identity/v3/projects/ac8a60cdb8f5489e889fdfdef9a73efb/users/3b3917c541d243b79f6eb57cd222f551/roles/cb2d2c8aadb342ac970c4bb846301c1d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:08.393503 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718abaf-b730-4dad-a235-58d6dbeb8312 None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.393979 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718abaf-b730-4dad-a235-58d6dbeb8312 None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.394102 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718abaf-b730-4dad-a235-58d6dbeb8312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.402480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:08.423226 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-f718abaf-b730-4dad-a235-58d6dbeb8312 None None] MFA Rules not processed for user `3b3917c541d243b79f6eb57cd222f551`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:08.424574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-f718abaf-b730-4dad-a235-58d6dbeb8312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:08.492123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1460/2895] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:08.503201 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:08.505021 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:08.563214 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d010f-74a6-434f-9dab-b4daf63207ee admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:08.566857 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff71c89-12ac-4aac-b0f5-b6bc5ea12f8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd267807215f54e2ea4c91383b178ee25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:08.567452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff71c89-12ac-4aac-b0f5-b6bc5ea12f8f service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:08.567731 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff71c89-12ac-4aac-b0f5-b6bc5ea12f8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:08.568000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff71c89-12ac-4aac-b0f5-b6bc5ea12f8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:08.577454 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff71c89-12ac-4aac-b0f5-b6bc5ea12f8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:08.578912 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff71c89-12ac-4aac-b0f5-b6bc5ea12f8f service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:08.588359 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1436/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:38:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:09.130985 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718abaf-b730-4dad-a235-58d6dbeb8312 None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:09.193845 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718abaf-b730-4dad-a235-58d6dbeb8312 None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:09.198606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:09.199233 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:09.199513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:09.199783 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] PATH_INFO: `/v3/users/ecb798227893485880d516d53d750c43` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:09.200889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb798227893485880d516d53d750c43)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:09.203413 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:09.250326 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb798227893485880d516d53d750c43'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.257628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb798227893485880d516d53d750c43'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.258260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb798227893485880d516d53d750c43'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.266047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb798227893485880d516d53d750c43'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.266692 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb798227893485880d516d53d750c43'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.283927 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1461/2897] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:38:09 2022] DELETE /identity/v3/users/ecb798227893485880d516d53d750c43 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:09.288368 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:09.288656 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:09.288934 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:09.307510 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:09.308712 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:09.367407 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1437/2898] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:09.378657 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:09.380799 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:09.391834 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:09.439528 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1338d-2cb8-4864-be15-d534eef81e33 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:09.443361 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:09.443964 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:09.444244 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:09.444549 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:09.453638 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:09.455101 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:09.464680 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1462/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:09.731333 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:09.733425 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:09.745408 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95620798-1c67-4851-bbf1-8b364be64b1b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:09.750125 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:09.750767 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:09.751038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:09.751336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] PATH_INFO: `/v3/projects/9e33d29e38964e2687d5acf2a265c644` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:09.752480 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e33d29e38964e2687d5acf2a265c644)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:09.754453 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:09.776516 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:09.802832 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e33d29e38964e2687d5acf2a265c644', 'request_id': 'req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.810335 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e33d29e38964e2687d5acf2a265c644', 'request_id': 'req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.816773 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e33d29e38964e2687d5acf2a265c644', 'request_id': 'req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.827191 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] The token cache is being invalidate because project 9e33d29e38964e2687d5acf2a265c644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:38:09.827485 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.828119 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.829602 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1438/2900] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:38:09 2022] DELETE /identity/v3/projects/9e33d29e38964e2687d5acf2a265c644 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 30 19:38:09.833609 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:09.845157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973e716-883a-4650-af62-1e135dc13dd2 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:09.905127 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:09.905963 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:09.906176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:09.906485 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] PATH_INFO: `/v3/users/3b3917c541d243b79f6eb57cd222f551` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:09.907617 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3917c541d243b79f6eb57cd222f551)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:09.909541 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:09.955360 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3917c541d243b79f6eb57cd222f551'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.962164 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3917c541d243b79f6eb57cd222f551'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.962818 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3917c541d243b79f6eb57cd222f551'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.970466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3917c541d243b79f6eb57cd222f551'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.971091 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-455b8b95-870d-4e2f-b401-631e545f0ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3917c541d243b79f6eb57cd222f551'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:09.989064 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1463/2901] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:38:09 2022] DELETE /identity/v3/users/3b3917c541d243b79f6eb57cd222f551 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:10.256987 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.258873 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:10.275230 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df5ca7-08f9-4d11-aab5-bf7b56e0d6bb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:10.334911 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:10.335463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.335739 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.336009 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] PATH_INFO: `/v3/projects/ac8a60cdb8f5489e889fdfdef9a73efb` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.337103 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac8a60cdb8f5489e889fdfdef9a73efb)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:10.339061 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:10.386616 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac8a60cdb8f5489e889fdfdef9a73efb', 'request_id': 'req-38f052b8-3884-4db1-ac59-bd401c006ad1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:10.395058 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac8a60cdb8f5489e889fdfdef9a73efb', 'request_id': 'req-38f052b8-3884-4db1-ac59-bd401c006ad1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:10.402193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac8a60cdb8f5489e889fdfdef9a73efb', 'request_id': 'req-38f052b8-3884-4db1-ac59-bd401c006ad1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:10.414766 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] The token cache is being invalidate because project ac8a60cdb8f5489e889fdfdef9a73efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:38:10.415053 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:10.415684 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-38f052b8-3884-4db1-ac59-bd401c006ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:10.417151 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1439/2902] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:38:10 2022] DELETE /identity/v3/projects/ac8a60cdb8f5489e889fdfdef9a73efb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:10.423568 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccca20-7dc2-4a4e-9649-5a6d62cfde1e None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.423863 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccca20-7dc2-4a4e-9649-5a6d62cfde1e None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.424145 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccca20-7dc2-4a4e-9649-5a6d62cfde1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.445487 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-91ccca20-7dc2-4a4e-9649-5a6d62cfde1e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:10.446715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-91ccca20-7dc2-4a4e-9649-5a6d62cfde1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:10.472809 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:10.506940 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1464/2903] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:38:10.515029 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aacdb-0267-4d24-af07-3e2dd45700f1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.515320 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aacdb-0267-4d24-af07-3e2dd45700f1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.515596 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42aacdb-0267-4d24-af07-3e2dd45700f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.535880 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a42aacdb-0267-4d24-af07-3e2dd45700f1 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:10.537076 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a42aacdb-0267-4d24-af07-3e2dd45700f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:10.544837 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1440/2904] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:10.549853 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccca20-7dc2-4a4e-9649-5a6d62cfde1e None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.559437 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccca20-7dc2-4a4e-9649-5a6d62cfde1e None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:10.564264 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:10.564904 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.565181 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.565452 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.566160 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:38:10.566466 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:10.568058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:10.579476 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1465/2905] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:38:10.583571 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aacdb-0267-4d24-af07-3e2dd45700f1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.593727 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42aacdb-0267-4d24-af07-3e2dd45700f1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:10.598427 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:10.599014 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.599293 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.599564 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.600184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:10.602088 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:10.629526 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1441/2906] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:38:10 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:10.633630 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.643434 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f839f7-f966-4df5-8b3b-829f4c462679 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:10.700628 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:10.701288 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.701511 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.701935 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.702807 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:10.704731 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:10.726128 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1466/2907] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:38:10 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:10.730193 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.743025 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc5dc6-1fd5-45f8-9a34-c3f3d8079f60 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:10.747795 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:10.748491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.748925 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.749212 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.749978 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:10.751760 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:10.754865 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:10.765068 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1442/2908] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:10.768739 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.778725 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd4fa5-f50e-4763-b41b-5376d0296d5d admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:10.783912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88137ae4-c2dc-4225-ac90-8b0f3d2c93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:10.784504 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88137ae4-c2dc-4225-ac90-8b0f3d2c93f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.784785 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88137ae4-c2dc-4225-ac90-8b0f3d2c93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.785058 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88137ae4-c2dc-4225-ac90-8b0f3d2c93f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.785696 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88137ae4-c2dc-4225-ac90-8b0f3d2c93f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:10.787445 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88137ae4-c2dc-4225-ac90-8b0f3d2c93f9 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:10.798454 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1467/2909] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:10.802699 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.812848 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033246f-1c5b-4e46-8ad5-de76f61c3bed admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:10.817494 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:10.818179 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.818463 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.818738 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] PATH_INFO: `/v3/projects/149a1656a16f4da4a2c8d3cb2ae551ba/users/935345730378444d8acbbe6b2eae9215/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.833802 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149a1656a16f4da4a2c8d3cb2ae551ba, user_id=935345730378444d8acbbe6b2eae9215, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:10.836470 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:10.850617 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1443/2910] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:38:10 2022] PUT /identity/v3/projects/149a1656a16f4da4a2c8d3cb2ae551ba/users/935345730378444d8acbbe6b2eae9215/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:10.861192 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30348e7-67a9-4cb3-a7aa-7fed9ee041fa None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:10.861480 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30348e7-67a9-4cb3-a7aa-7fed9ee041fa None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:10.861756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30348e7-67a9-4cb3-a7aa-7fed9ee041fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:10.889942 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-a30348e7-67a9-4cb3-a7aa-7fed9ee041fa None None] MFA Rules not processed for user `935345730378444d8acbbe6b2eae9215`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:10.891173 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a30348e7-67a9-4cb3-a7aa-7fed9ee041fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:10.953219 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1468/2911] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:10.965570 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:10.967263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:11.022907 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88158e02-96d0-44b8-aaf2-6a378e9ba9e7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:11.026530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bbcd5-ac1f-413e-b335-c92b0cc19a28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5190ae783a4c89b51797729aaaa6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:11.027124 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bbcd5-ac1f-413e-b335-c92b0cc19a28 service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:11.027398 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bbcd5-ac1f-413e-b335-c92b0cc19a28 service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:11.027667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bbcd5-ac1f-413e-b335-c92b0cc19a28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:11.035957 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bbcd5-ac1f-413e-b335-c92b0cc19a28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:11.037365 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bbcd5-ac1f-413e-b335-c92b0cc19a28 service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:11.046682 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1444/2912] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:38:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:20.949654 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:21.042045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:31.846158 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30348e7-67a9-4cb3-a7aa-7fed9ee041fa None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:31.909067 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30348e7-67a9-4cb3-a7aa-7fed9ee041fa None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:31.913660 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:31.914314 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:31.914599 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:31.914873 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] PATH_INFO: `/v3/users/935345730378444d8acbbe6b2eae9215` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:31.916012 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=935345730378444d8acbbe6b2eae9215)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:31.917925 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:31.963674 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935345730378444d8acbbe6b2eae9215'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:31.970876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935345730378444d8acbbe6b2eae9215'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:31.971512 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935345730378444d8acbbe6b2eae9215'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:31.978569 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935345730378444d8acbbe6b2eae9215'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:31.979275 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935345730378444d8acbbe6b2eae9215'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:31.996047 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1469/2913] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:38:31 2022] DELETE /identity/v3/users/935345730378444d8acbbe6b2eae9215 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:32.000689 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.001168 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.001268 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.021322 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:32.022548 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:32.084028 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1445/2914] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:38:32.094878 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.096292 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:32.154415 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc2220-d052-445c-945d-d40527996dfb admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.158109 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d67f7-b4fd-4a2c-9042-e695294beddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.158713 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d67f7-b4fd-4a2c-9042-e695294beddb service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.159002 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d67f7-b4fd-4a2c-9042-e695294beddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.159277 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d67f7-b4fd-4a2c-9042-e695294beddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.168909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d67f7-b4fd-4a2c-9042-e695294beddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.170499 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d67f7-b4fd-4a2c-9042-e695294beddb service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:32.179762 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1470/2915] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:32.454452 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.455889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:32.469085 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa89e0f-7947-4ed1-b03d-df97e37d4f6e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.474145 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.474769 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.475045 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.475314 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] PATH_INFO: `/v3/projects/149a1656a16f4da4a2c8d3cb2ae551ba` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.476419 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=149a1656a16f4da4a2c8d3cb2ae551ba)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.478517 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:32.534351 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149a1656a16f4da4a2c8d3cb2ae551ba', 'request_id': 'req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:32.541855 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149a1656a16f4da4a2c8d3cb2ae551ba', 'request_id': 'req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:32.549459 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149a1656a16f4da4a2c8d3cb2ae551ba', 'request_id': 'req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:32.561993 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] The token cache is being invalidate because project 149a1656a16f4da4a2c8d3cb2ae551ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:38:32.562541 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:32.563336 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ebe5e721-670a-4ac3-b0cb-537cd1400d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:32.565027 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1446/2916] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:38:32 2022] DELETE /identity/v3/projects/149a1656a16f4da4a2c8d3cb2ae551ba => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:32.570494 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd70f29-0320-4ab6-a628-b8c67707030f None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.570798 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd70f29-0320-4ab6-a628-b8c67707030f None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.571094 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd70f29-0320-4ab6-a628-b8c67707030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.593148 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-dcd70f29-0320-4ab6-a628-b8c67707030f None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:32.594304 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dcd70f29-0320-4ab6-a628-b8c67707030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:32.611260 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:32.655070 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1471/2917] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:32.663883 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5250476-d60d-47c3-a8ac-7c75b9edeab8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.664178 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5250476-d60d-47c3-a8ac-7c75b9edeab8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.664457 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5250476-d60d-47c3-a8ac-7c75b9edeab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.684257 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b5250476-d60d-47c3-a8ac-7c75b9edeab8 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:32.685456 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5250476-d60d-47c3-a8ac-7c75b9edeab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:32.693263 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1447/2918] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 30 19:38:32.697909 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd70f29-0320-4ab6-a628-b8c67707030f None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.707530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd70f29-0320-4ab6-a628-b8c67707030f None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.712123 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.713324 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.713822 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.714150 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] PATH_INFO: `/v3/domains` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.714805 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81455) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 30 19:38:32.715112 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.716704 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:32.728424 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1472/2919] 10.222.0.18 () {58 vars in 1153 bytes} [Fri Sep 30 19:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 30 19:38:32.732681 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5250476-d60d-47c3-a8ac-7c75b9edeab8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.741705 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5250476-d60d-47c3-a8ac-7c75b9edeab8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.746436 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.747023 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.747299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.747566 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.748184 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.750081 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:32.786227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1448/2920] 10.222.0.18 () {60 vars in 1153 bytes} [Fri Sep 30 19:38:32 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:32.790453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.800492 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b341-e359-4d63-8018-a20cba96a30c admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.857350 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.858016 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.858157 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.858410 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] PATH_INFO: `/v3/users` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.859035 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.860934 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:32.885777 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1473/2921] 10.222.0.18 () {60 vars in 1144 bytes} [Fri Sep 30 19:38:32 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 30 19:38:32.890227 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.900386 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa11bd-05ab-4396-a315-b8b4400e4132 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.904870 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.905458 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.905732 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.906000 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.906658 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.908229 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:32.917889 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1449/2922] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:32.921756 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.932697 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ba9d2-11fe-4b16-803b-c7a606b5b08e admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.937273 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1edf7-6bbd-4bd3-abfe-2c46bd9cb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.937861 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1edf7-6bbd-4bd3-abfe-2c46bd9cb5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.938176 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1edf7-6bbd-4bd3-abfe-2c46bd9cb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.938453 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1edf7-6bbd-4bd3-abfe-2c46bd9cb5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.939085 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1edf7-6bbd-4bd3-abfe-2c46bd9cb5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.940663 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1edf7-6bbd-4bd3-abfe-2c46bd9cb5ec admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:32.953197 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1474/2923] 10.222.0.18 () {58 vars in 1122 bytes} [Fri Sep 30 19:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 30 19:38:32.957273 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:32.967305 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec07e3e-7ce1-4611-9722-2112dbacad1d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:32.972255 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:32.972897 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:32.973176 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:32.973450 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] PATH_INFO: `/v3/projects/5622a3ea95d74301a0c3e52c11612534/users/ea841e6813d54ec7946c548e86d05a5e/roles/101229ee973c472f99780a668e4c403f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:32.988413 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5622a3ea95d74301a0c3e52c11612534, user_id=ea841e6813d54ec7946c548e86d05a5e, role_id=101229ee973c472f99780a668e4c403f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:32.991107 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:33.005052 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1450/2924] 10.222.0.18 () {60 vars in 1483 bytes} [Fri Sep 30 19:38:32 2022] PUT /identity/v3/projects/5622a3ea95d74301a0c3e52c11612534/users/ea841e6813d54ec7946c548e86d05a5e/roles/101229ee973c472f99780a668e4c403f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:33.015691 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2e1f-3c0b-4c49-913f-5b104182e59c None None] REQUEST_METHOD: `POST` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:33.015978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2e1f-3c0b-4c49-913f-5b104182e59c None None] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:33.016250 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2e1f-3c0b-4c49-913f-5b104182e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:33.043574 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.auth.core [None req-dedd2e1f-3c0b-4c49-913f-5b104182e59c None None] MFA Rules not processed for user `ea841e6813d54ec7946c548e86d05a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81455) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:33.044810 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-dedd2e1f-3c0b-4c49-913f-5b104182e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:33.110889 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1475/2925] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:33.123329 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:33.125100 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:33.139499 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:33.185667 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec7cde-1c26-49aa-acaf-806f2396d69b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:33.189299 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2a6b3-8711-4fed-91a2-c04350011426 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f5190ae783a4c89b51797729aaaa6ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:33.189892 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2a6b3-8711-4fed-91a2-c04350011426 service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:33.190216 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2a6b3-8711-4fed-91a2-c04350011426 service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:33.190491 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2a6b3-8711-4fed-91a2-c04350011426 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:33.199710 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2a6b3-8711-4fed-91a2-c04350011426 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:33.201120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2a6b3-8711-4fed-91a2-c04350011426 service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:33.209860 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1451/2926] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:38:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:43.107876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:43.205869 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=21 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:38:53.756382 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd2e1f-3c0b-4c49-913f-5b104182e59c None None] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:53.821446 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedd2e1f-3c0b-4c49-913f-5b104182e59c None None] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:53.825936 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:53.826600 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:53.826885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:53.827241 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] PATH_INFO: `/v3/users/ea841e6813d54ec7946c548e86d05a5e` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:53.828530 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea841e6813d54ec7946c548e86d05a5e)` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:53.830490 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:53.876919 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea841e6813d54ec7946c548e86d05a5e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:53.883978 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea841e6813d54ec7946c548e86d05a5e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:53.884583 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea841e6813d54ec7946c548e86d05a5e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:53.891525 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea841e6813d54ec7946c548e86d05a5e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:53.892161 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.notifications [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea841e6813d54ec7946c548e86d05a5e'} {{(pid=81455) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:53.909560 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1476/2927] 10.222.0.18 () {58 vars in 1224 bytes} [Fri Sep 30 19:38:53 2022] DELETE /identity/v3/users/ea841e6813d54ec7946c548e86d05a5e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:38:53.914090 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:53.914625 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:53.914735 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:53.935038 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] MFA Rules not processed for user `f75c03e5ed174ef098321b91fb4a9510`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 30 19:38:53.936394 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:53.996441 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1452/2928] 10.222.0.18 () {58 vars in 958 bytes} [Fri Sep 30 19:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 30 19:38:54.006577 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:54.008189 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:54.071513 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e02064-c5f4-4cf3-8ddc-1245e2203687 admin admin] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:54.075559 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38287d3f91704657bc26c5b4d50c0315', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:54.076166 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:54.076444 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:54.076715 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:54.086236 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:54.087671 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:54.098376 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1477/2929] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:38:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:38:54.365546 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:38:54.367011 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:38:54.380272 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e949a8b-86fb-4dd6-a8f1-cea5dbe6fb86 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:38:54.384899 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f75c03e5ed174ef098321b91fb4a9510', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3b383133b449569f26f949e441f7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:38:54.385533 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:38:54.385811 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:38:54.386120 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] PATH_INFO: `/v3/projects/5622a3ea95d74301a0c3e52c11612534` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:38:54.387232 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5622a3ea95d74301a0c3e52c11612534)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:38:54.389147 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:38:54.435530 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5622a3ea95d74301a0c3e52c11612534', 'request_id': 'req-c07fafd6-0430-495c-954b-de2a24e09930'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:54.443498 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5622a3ea95d74301a0c3e52c11612534', 'request_id': 'req-c07fafd6-0430-495c-954b-de2a24e09930'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:54.449772 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5622a3ea95d74301a0c3e52c11612534', 'request_id': 'req-c07fafd6-0430-495c-954b-de2a24e09930'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:54.460083 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] The token cache is being invalidate because project 5622a3ea95d74301a0c3e52c11612534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 30 19:38:54.460371 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:54.460989 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c07fafd6-0430-495c-954b-de2a24e09930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 30 19:38:54.462512 dv-cinder-860015-1-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1453/2930] 10.222.0.18 () {58 vars in 1233 bytes} [Fri Sep 30 19:38:54 2022] DELETE /identity/v3/projects/5622a3ea95d74301a0c3e52c11612534 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 30 19:39:04.093743 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:39:04.457069 dv-cinder-860015-1-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 30 19:41:44.915918 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] Authenticating user token {{(pid=81455) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 30 19:41:44.917355 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:41:44.984876 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351bd25-d474-42c0-b33e-50431861b937 service neutron] Validating token access rules against request {{(pid=81455) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 30 19:41:45.043467 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a1fb3-be0b-4a78-8a38-a93401e68ef9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '632070e9f5534d54852df7f6f0d50461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5618831a00444e17a2b85a876ed782be', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81455) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 30 19:41:45.044066 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1fb3-be0b-4a78-8a38-a93401e68ef9 service placement] REQUEST_METHOD: `GET` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 30 19:41:45.044339 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1fb3-be0b-4a78-8a38-a93401e68ef9 service placement] SCRIPT_NAME: `/identity` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 30 19:41:45.044606 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a1fb3-be0b-4a78-8a38-a93401e68ef9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81455) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 30 19:41:45.046330 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.fernet_utils [None req-1f8a1fb3-be0b-4a78-8a38-a93401e68ef9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81455) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 30 19:41:45.057885 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a1fb3-be0b-4a78-8a38-a93401e68ef9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 30 19:41:45.060140 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a1fb3-be0b-4a78-8a38-a93401e68ef9 service placement] RBAC: Authorization granted {{(pid=81455) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 30 19:41:45.071653 dv-cinder-860015-1-smb devstack@keystone.service[81455]: [pid: 81455|app: 0|req: 1478/2931] 10.222.0.18 () {60 vars in 1365 bytes} [Fri Sep 30 19:41:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 30 19:41:55.066912 dv-cinder-860015-1-smb devstack@keystone.service[81455]: DEBUG dbcounter [-] [81455] Writing DB stats keystone:SELECT=58 {{(pid=81455) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}